Jul 22 15:12:49.526923 ip-10-0-136-36 systemd[1]: Starting Kubernetes Kubelet... Jul 22 15:12:49.927503 ip-10-0-136-36 kubenswrapper[2542]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 15:12:49.927503 ip-10-0-136-36 kubenswrapper[2542]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 15:12:49.927503 ip-10-0-136-36 kubenswrapper[2542]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 15:12:49.927503 ip-10-0-136-36 kubenswrapper[2542]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 15:12:49.927503 ip-10-0-136-36 kubenswrapper[2542]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 15:12:49.928150 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.927511 2542 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 15:12:49.931523 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931507 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.931523 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931523 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931527 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931531 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931533 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931536 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931538 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931541 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931543 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931546 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931549 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931553 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931557 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931560 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931562 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931566 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931569 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931572 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931574 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931576 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.931588 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931579 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931583 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931586 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931588 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931591 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931594 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931597 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931600 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931602 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931605 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931607 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931610 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931612 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931615 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931617 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931620 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931622 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931625 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931627 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931630 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.932069 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931649 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931652 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931654 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931656 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931659 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931663 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931666 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931668 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931671 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931673 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931676 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931679 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931681 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931684 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931687 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931691 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931694 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931696 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931699 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.932540 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931702 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931704 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931708 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931712 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931715 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931717 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931720 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931722 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931725 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931727 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931730 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931732 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931735 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931737 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931740 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931743 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931745 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931747 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931751 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931753 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.933036 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931756 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931758 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931761 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931763 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931765 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931769 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931772 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931776 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931778 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931781 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931783 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931786 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931788 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931790 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931793 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931796 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931798 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931801 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931803 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.931805 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.933511 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933205 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933212 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933216 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933219 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933222 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933225 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933227 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933230 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933233 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933235 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933238 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933240 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933243 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933247 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933250 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933253 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933256 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933259 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933262 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933265 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.934002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933268 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933271 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933273 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933275 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933278 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933280 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933283 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933285 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933288 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933290 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933292 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933295 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933297 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933299 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933302 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933305 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933307 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933310 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933312 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.934486 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933314 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933317 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933319 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933322 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933325 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933328 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933330 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933333 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933335 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933337 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933344 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933346 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933349 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933352 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933354 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933357 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933359 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933362 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933364 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933368 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.934955 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933370 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933373 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933375 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933377 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933380 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933382 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933385 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933387 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933391 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933395 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933397 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933400 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933402 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933405 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933409 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933413 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933416 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933419 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933423 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.935431 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933426 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933429 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933432 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933436 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933439 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933441 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933444 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933446 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933448 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933451 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933454 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933457 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933459 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933462 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933464 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933467 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933469 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933472 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933474 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933476 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.935900 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933479 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933833 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933838 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933841 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933844 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933848 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933851 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933854 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933857 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933862 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933864 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933867 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933869 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933872 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933874 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933879 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933882 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933885 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933887 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933890 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.936380 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933892 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933895 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933898 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933901 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933903 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933906 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933908 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933910 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933923 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933927 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933930 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933933 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933936 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933939 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933941 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933943 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933946 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933948 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933951 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.937002 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933953 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933956 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933960 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933963 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933966 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933968 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933970 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933973 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933977 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933979 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933982 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933985 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933987 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933990 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933992 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933995 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.933997 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934000 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934002 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934005 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.937469 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934008 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934011 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934014 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934016 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934019 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934021 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934023 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934026 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934028 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934031 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934033 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934035 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934038 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934040 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934044 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934046 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934049 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934052 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934054 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.937989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934056 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934059 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934062 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934064 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934068 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934071 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934074 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934076 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934079 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934082 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934084 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934086 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934089 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934091 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934093 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934096 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934098 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934100 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934103 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934105 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.938487 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934107 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934110 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934175 2542 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934182 2542 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934187 2542 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934191 2542 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934194 2542 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934197 2542 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934202 2542 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934206 2542 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934209 2542 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934212 2542 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934215 2542 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934219 2542 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934222 2542 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934224 2542 flags.go:64] FLAG: --cgroup-root="" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934227 2542 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934230 2542 flags.go:64] FLAG: --client-ca-file="" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934233 2542 flags.go:64] FLAG: --cloud-provider="external" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934235 2542 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934240 2542 flags.go:64] FLAG: --cluster-domain="" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934243 2542 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934245 2542 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934248 2542 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 15:12:49.938989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934251 2542 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934255 2542 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934257 2542 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934260 2542 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934263 2542 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934266 2542 flags.go:64] FLAG: --contention-profiling="false" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934269 2542 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934272 2542 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934275 2542 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934277 2542 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934281 2542 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934284 2542 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934286 2542 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934289 2542 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934292 2542 flags.go:64] FLAG: --enable-server="true" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934294 2542 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934298 2542 flags.go:64] FLAG: --event-burst="100" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934302 2542 flags.go:64] FLAG: --event-qps="50" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934305 2542 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934307 2542 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934310 2542 flags.go:64] FLAG: --eviction-hard="" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934314 2542 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934316 2542 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934319 2542 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934322 2542 flags.go:64] FLAG: --eviction-soft="" Jul 22 15:12:49.939550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934324 2542 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934327 2542 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934329 2542 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934332 2542 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934335 2542 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934337 2542 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934340 2542 flags.go:64] FLAG: --feature-gates="" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934343 2542 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934346 2542 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934349 2542 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934351 2542 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934354 2542 flags.go:64] FLAG: --healthz-port="10248" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934357 2542 flags.go:64] FLAG: --help="false" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934360 2542 flags.go:64] FLAG: --hostname-override="ip-10-0-136-36.ec2.internal" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934363 2542 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934365 2542 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934368 2542 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934371 2542 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934374 2542 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934377 2542 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934379 2542 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934382 2542 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934385 2542 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 15:12:49.940174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934387 2542 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934390 2542 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934393 2542 flags.go:64] FLAG: --kube-reserved="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934396 2542 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934398 2542 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934401 2542 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934404 2542 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934406 2542 flags.go:64] FLAG: --lock-file="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934409 2542 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934411 2542 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934414 2542 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934423 2542 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934426 2542 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934429 2542 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934431 2542 flags.go:64] FLAG: --logging-format="text" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934434 2542 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934437 2542 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934439 2542 flags.go:64] FLAG: --manifest-url="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934442 2542 flags.go:64] FLAG: --manifest-url-header="" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934446 2542 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934449 2542 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934452 2542 flags.go:64] FLAG: --max-pods="110" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934455 2542 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934459 2542 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934462 2542 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 15:12:49.940804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934465 2542 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934467 2542 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934470 2542 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934473 2542 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934479 2542 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934482 2542 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934485 2542 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934487 2542 flags.go:64] FLAG: --pod-cidr="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934490 2542 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934496 2542 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934499 2542 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934504 2542 flags.go:64] FLAG: --pods-per-core="0" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934507 2542 flags.go:64] FLAG: --port="10250" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934509 2542 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934513 2542 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0399703d5fcf8e5f8" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934516 2542 flags.go:64] FLAG: --qos-reserved="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934518 2542 flags.go:64] FLAG: --read-only-port="10255" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934521 2542 flags.go:64] FLAG: --register-node="true" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934524 2542 flags.go:64] FLAG: --register-with-taints="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934527 2542 flags.go:64] FLAG: --registry-burst="10" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934530 2542 flags.go:64] FLAG: --registry-qps="5" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934533 2542 flags.go:64] FLAG: --reserved-cpus="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934535 2542 flags.go:64] FLAG: --reserved-memory="" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934538 2542 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934541 2542 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 15:12:49.941400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934544 2542 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934546 2542 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934549 2542 flags.go:64] FLAG: --runonce="false" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934552 2542 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934555 2542 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934559 2542 flags.go:64] FLAG: --seccomp-default="false" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934562 2542 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934564 2542 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934567 2542 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934570 2542 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934572 2542 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934575 2542 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934578 2542 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934581 2542 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934583 2542 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934586 2542 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934589 2542 flags.go:64] FLAG: --system-cgroups="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934591 2542 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934604 2542 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934607 2542 flags.go:64] FLAG: --tls-cert-file="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934609 2542 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934613 2542 flags.go:64] FLAG: --tls-min-version="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934616 2542 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934619 2542 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934621 2542 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 15:12:49.942033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934624 2542 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934627 2542 flags.go:64] FLAG: --v="2" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934649 2542 flags.go:64] FLAG: --version="false" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934653 2542 flags.go:64] FLAG: --vmodule="" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934656 2542 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.934659 2542 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934763 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934766 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934769 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934772 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934774 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934777 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934781 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934784 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934786 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934789 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934791 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934794 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934796 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934798 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934801 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.942910 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934804 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934806 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934809 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934811 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934815 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934818 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934821 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934824 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934826 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934829 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934832 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934836 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934839 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934842 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934845 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934848 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934851 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934853 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934856 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.943685 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934858 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934861 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934863 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934866 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934869 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934872 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934876 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934879 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934882 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934885 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934887 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934890 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934892 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934895 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934898 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934900 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934902 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934906 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934908 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934911 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.944251 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934914 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934916 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934919 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934922 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934925 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934927 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934930 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934932 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934934 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934937 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934939 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934942 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934944 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934947 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934949 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934952 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934955 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934958 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934961 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934963 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.944772 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934966 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934969 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934971 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934975 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934978 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934981 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934984 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934986 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934989 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934992 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934995 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.934997 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935000 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935003 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935005 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935008 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935010 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935013 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935015 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935017 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.945245 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935020 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935022 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935025 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935028 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.935030 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.935608 2542 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.941770 2542 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.941783 2542 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.941800 2542 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.941805 2542 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941863 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941868 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941871 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941874 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941877 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.945738 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941879 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941883 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941885 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941888 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941890 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941892 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941895 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941897 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941900 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941903 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941906 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941908 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941911 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941913 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941925 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941927 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941930 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941933 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941935 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941937 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.946128 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941940 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941942 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941945 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941947 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941951 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941955 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941958 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941961 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941964 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941967 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941970 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941972 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941975 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941977 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941979 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941982 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941984 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941987 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941990 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941992 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.946600 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941995 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.941997 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942000 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942003 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942005 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942008 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942010 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942013 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942015 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942018 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942020 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942023 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942025 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942027 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942030 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942032 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942037 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942041 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942043 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.947138 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942046 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942048 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942051 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942054 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942057 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942061 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942064 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942066 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942069 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942072 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942075 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942078 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942080 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942083 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942085 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942088 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942091 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942093 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942096 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942098 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.947656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942101 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942104 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942106 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942108 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942111 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942113 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942115 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942117 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942120 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942123 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942126 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942129 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942131 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942134 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942136 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.948137 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.942141 2542 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942588 2542 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942659 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942665 2542 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942672 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942676 2542 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942681 2542 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942685 2542 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942696 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942701 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942706 2542 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942710 2542 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942714 2542 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942718 2542 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942758 2542 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942764 2542 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942768 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942772 2542 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942776 2542 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 15:12:49.948521 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942780 2542 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942784 2542 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942793 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942797 2542 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942801 2542 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942805 2542 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942809 2542 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942814 2542 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942818 2542 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942823 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942827 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942831 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942836 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942840 2542 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942844 2542 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942852 2542 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942856 2542 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942861 2542 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942865 2542 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942870 2542 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 15:12:49.949007 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942874 2542 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942878 2542 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942881 2542 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942886 2542 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942890 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942894 2542 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942898 2542 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942907 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942955 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942962 2542 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942966 2542 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.942970 2542 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943005 2542 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943010 2542 feature_gate.go:328] unrecognized feature gate: Example Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943014 2542 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943018 2542 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943022 2542 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943027 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943032 2542 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943036 2542 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 15:12:49.949476 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943046 2542 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943050 2542 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943055 2542 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943060 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943064 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943068 2542 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943072 2542 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943077 2542 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943081 2542 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943085 2542 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943090 2542 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943094 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943102 2542 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943106 2542 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943111 2542 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943115 2542 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943119 2542 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943125 2542 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943130 2542 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 15:12:49.949970 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943135 2542 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943139 2542 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943173 2542 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943178 2542 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943182 2542 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943192 2542 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943196 2542 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943200 2542 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943204 2542 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943210 2542 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943216 2542 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943221 2542 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943225 2542 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943229 2542 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943234 2542 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943240 2542 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943245 2542 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943250 2542 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943260 2542 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 15:12:49.950447 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943264 2542 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943269 2542 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:49.943273 2542 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.943279 2542 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.943427 2542 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.946975 2542 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.948177 2542 server.go:1019] "Starting client certificate rotation" Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.948270 2542 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.948296 2542 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 15:12:49.951052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.950483 2542 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 15:12:49.954725 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.954662 2542 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 15:12:49.960784 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.960770 2542 log.go:25] "Validated CRI v1 runtime API" Jul 22 15:12:49.965301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.965275 2542 log.go:25] "Validated CRI v1 image API" Jul 22 15:12:49.966176 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.966163 2542 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 15:12:49.968611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.968589 2542 fs.go:135] Filesystem UUIDs: map[51ad6c96-91dd-4226-9d15-ab5e31a54610:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fbca45f1-af2b-4ff1-9cbd-7506b98267ed:/dev/nvme0n1p4] Jul 22 15:12:49.968715 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.968610 2542 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 15:12:49.975846 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.975733 2542 manager.go:216] Machine: {Timestamp:2026-07-22 15:12:49.974428425 +0000 UTC m=+0.334510665 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097054 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238dd397e0086089d8efc974f10664 SystemUUID:ec238dd3-97e0-0860-89d8-efc974f10664 BootID:19388501-9596-483c-8142-44976f68c9b4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:17:f3:50:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:17:f3:50:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:60:49:d6:04:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 15:12:49.975846 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.975839 2542 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 15:12:49.976012 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.975928 2542 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 15:12:49.979614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.979592 2542 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 15:12:49.979808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.979616 2542 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 15:12:49.980505 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.980490 2542 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 15:12:49.981246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.981234 2542 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 15:12:49.981306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.981252 2542 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 15:12:49.981306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.981263 2542 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 15:12:49.982024 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.982012 2542 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 15:12:49.983478 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.983465 2542 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 15:12:49.986493 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986479 2542 state_mem.go:36] "Initialized new in-memory state store" Jul 22 15:12:49.986768 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986755 2542 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 15:12:49.986843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986801 2542 kubelet.go:486] "Attempting to sync node with API server" Jul 22 15:12:49.986843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986820 2542 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 15:12:49.986843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986838 2542 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 15:12:49.986977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986850 2542 kubelet.go:398] "Adding apiserver pod source" Jul 22 15:12:49.986977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.986862 2542 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 15:12:49.987655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.987626 2542 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 15:12:49.987719 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.987666 2542 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 15:12:49.990570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.990552 2542 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 15:12:49.994385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.994364 2542 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 15:12:49.994444 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.994399 2542 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 15:12:49.995022 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995010 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 15:12:49.995064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995027 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 15:12:49.995064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995033 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 15:12:49.995064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995038 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 15:12:49.995064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995048 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 15:12:49.995064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995056 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995146 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995153 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995159 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995165 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995174 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 15:12:49.995191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.995182 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 15:12:49.996046 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.996035 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 15:12:49.996046 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.996046 2542 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 15:12:49.997581 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:49.997557 2542 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 15:12:49.997694 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:49.997676 2542 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 15:12:49.999226 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.999213 2542 server.go:1268] "Started kubelet" Jul 22 15:12:49.999372 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.999317 2542 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 15:12:49.999459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.999385 2542 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 15:12:49.999459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:49.999335 2542 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 15:12:50.000057 ip-10-0-136-36 systemd[1]: Started Kubernetes Kubelet. Jul 22 15:12:50.000579 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.000432 2542 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 15:12:50.001939 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.001925 2542 server.go:310] "Adding debug handlers to kubelet server" Jul 22 15:12:50.005692 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.005669 2542 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 15:12:50.009395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.009380 2542 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 15:12:50.010342 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.009347 2542 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-36.ec2.internal.18c4a55cb8a88496 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-36.ec2.internal,UID:ip-10-0-136-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-36.ec2.internal,},FirstTimestamp:2026-07-22 15:12:49.999185046 +0000 UTC m=+0.359267285,LastTimestamp:2026-07-22 15:12:49.999185046 +0000 UTC m=+0.359267285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-36.ec2.internal,}" Jul 22 15:12:50.011144 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.011121 2542 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 15:12:50.011769 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.011751 2542 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 15:12:50.011985 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.011972 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.012534 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012515 2542 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 15:12:50.012624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012534 2542 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 15:12:50.012624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012555 2542 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 15:12:50.012731 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012673 2542 reconstruct.go:97] "Volume reconstruction finished" Jul 22 15:12:50.012731 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012686 2542 reconciler.go:29] "Reconciler: start to sync state" Jul 22 15:12:50.012789 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012756 2542 factory.go:55] Registering systemd factory Jul 22 15:12:50.012789 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012771 2542 factory.go:223] Registration of the systemd container factory successfully Jul 22 15:12:50.012981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012964 2542 factory.go:153] Registering CRI-O factory Jul 22 15:12:50.012981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.012980 2542 factory.go:223] Registration of the crio container factory successfully Jul 22 15:12:50.013119 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.013030 2542 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 15:12:50.013119 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.013047 2542 factory.go:103] Registering Raw factory Jul 22 15:12:50.013119 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.013058 2542 manager.go:1196] Started watching for new ooms in manager Jul 22 15:12:50.013395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.013380 2542 manager.go:349] Starting recovery of all containers Jul 22 15:12:50.013779 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.013751 2542 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 15:12:50.029034 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.028885 2542 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 15:12:50.029733 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.029715 2542 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwrbj" Jul 22 15:12:50.032184 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.032166 2542 manager.go:354] Recovery completed Jul 22 15:12:50.036886 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.036871 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.037343 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.037328 2542 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwrbj" Jul 22 15:12:50.038790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.038772 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.038855 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.038803 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.038855 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.038813 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.039354 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.039338 2542 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 15:12:50.039354 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.039350 2542 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 15:12:50.039467 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.039364 2542 state_mem.go:36] "Initialized new in-memory state store" Jul 22 15:12:50.039467 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.039365 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.040129 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.040115 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.040187 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.040144 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.040187 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.040155 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.041501 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.041489 2542 policy_none.go:49] "None policy: Start" Jul 22 15:12:50.041552 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.041506 2542 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 15:12:50.041552 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.041516 2542 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 15:12:50.042578 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.042564 2542 policy_none.go:47] "Start" Jul 22 15:12:50.073216 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073204 2542 manager.go:337] "Starting Device Plugin manager" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.073247 2542 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073255 2542 server.go:87] "Starting device plugin registration server" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073443 2542 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073455 2542 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073528 2542 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073601 2542 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.073609 2542 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.074144 2542 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 15:12:50.086114 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.074186 2542 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.114090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.114069 2542 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 15:12:50.115388 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.115368 2542 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 15:12:50.115470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.115407 2542 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 15:12:50.115470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.115428 2542 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 15:12:50.115470 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.115457 2542 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 15:12:50.118241 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.118225 2542 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 15:12:50.174340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.174320 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.175300 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.175286 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.175355 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.175313 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.175355 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.175324 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.175355 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.175345 2542 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.185324 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.185289 2542 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.185324 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.185309 2542 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-36.ec2.internal\": node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.203884 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.203863 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.216321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.216301 2542 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal"] Jul 22 15:12:50.216412 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.216357 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.217064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.217051 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.217122 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.217077 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.217122 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.217087 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.218683 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.218671 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.218729 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.218718 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.218764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.218748 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.219321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219303 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.219413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219326 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.219413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219340 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.219413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219376 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.219413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219400 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.219413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.219413 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.220459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.220445 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.220521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.220470 2542 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 15:12:50.221126 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.221109 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientMemory" Jul 22 15:12:50.221215 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.221136 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 15:12:50.221215 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.221151 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeHasSufficientPID" Jul 22 15:12:50.255184 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.255167 2542 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-36.ec2.internal\" not found" node="ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.259374 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.259359 2542 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-36.ec2.internal\" not found" node="ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.304783 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.304764 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.405327 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.405309 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.414664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.414628 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.414712 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.414670 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.414712 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.414693 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22335277600545a94aa18b4597eb4b80-config\") pod \"kube-apiserver-proxy-ip-10-0-136-36.ec2.internal\" (UID: \"22335277600545a94aa18b4597eb4b80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.506051 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.506009 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.515365 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515347 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.515409 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515369 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.515409 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515385 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22335277600545a94aa18b4597eb4b80-config\") pod \"kube-apiserver-proxy-ip-10-0-136-36.ec2.internal\" (UID: \"22335277600545a94aa18b4597eb4b80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.515470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515419 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22335277600545a94aa18b4597eb4b80-config\") pod \"kube-apiserver-proxy-ip-10-0-136-36.ec2.internal\" (UID: \"22335277600545a94aa18b4597eb4b80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.515501 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515466 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.515501 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.515446 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a0275174239c1505375b9fbc7c088a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal\" (UID: \"e6a0275174239c1505375b9fbc7c088a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.557490 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.557469 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.563590 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.563571 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:50.606460 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.606435 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.706923 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.706898 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.807480 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.807431 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.908023 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:50.908000 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:50.947497 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.947476 2542 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 15:12:50.947978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:50.947605 2542 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 15:12:51.009014 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:51.008998 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:51.042234 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.042200 2542 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 15:07:50 +0000 UTC" deadline="2027-12-25 22:49:29.873754434 +0000 UTC" Jul 22 15:12:51.042234 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.042226 2542 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12511h36m38.831531461s" Jul 22 15:12:51.102392 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:51.102365 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22335277600545a94aa18b4597eb4b80.slice/crio-2e232d187370129b29ddfa6c3a845894e2a30c21dbc5392de380584f2507e8b7 WatchSource:0}: Error finding container 2e232d187370129b29ddfa6c3a845894e2a30c21dbc5392de380584f2507e8b7: Status 404 returned error can't find the container with id 2e232d187370129b29ddfa6c3a845894e2a30c21dbc5392de380584f2507e8b7 Jul 22 15:12:51.102593 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:51.102572 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a0275174239c1505375b9fbc7c088a.slice/crio-b80810a76986cff199929de58ce00b0fd5a574f1aecd781ff47d28e4f1e21ada WatchSource:0}: Error finding container b80810a76986cff199929de58ce00b0fd5a574f1aecd781ff47d28e4f1e21ada: Status 404 returned error can't find the container with id b80810a76986cff199929de58ce00b0fd5a574f1aecd781ff47d28e4f1e21ada Jul 22 15:12:51.107613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.107592 2542 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 15:12:51.109206 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:51.109182 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:51.119374 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.119335 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" event={"ID":"e6a0275174239c1505375b9fbc7c088a","Type":"ContainerStarted","Data":"b80810a76986cff199929de58ce00b0fd5a574f1aecd781ff47d28e4f1e21ada"} Jul 22 15:12:51.120284 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.120259 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" event={"ID":"22335277600545a94aa18b4597eb4b80","Type":"ContainerStarted","Data":"2e232d187370129b29ddfa6c3a845894e2a30c21dbc5392de380584f2507e8b7"} Jul 22 15:12:51.209531 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:51.209498 2542 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-36.ec2.internal\" not found" Jul 22 15:12:51.272579 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.272561 2542 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 15:12:51.312971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.312952 2542 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" Jul 22 15:12:51.327000 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.326981 2542 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 15:12:51.328958 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.328945 2542 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" Jul 22 15:12:51.339066 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.339049 2542 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 15:12:51.512890 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.512826 2542 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 15:12:51.559400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.559374 2542 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 15:12:51.845321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.845233 2542 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 15:12:51.988848 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.988502 2542 apiserver.go:52] "Watching apiserver" Jul 22 15:12:51.996412 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.996385 2542 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 15:12:51.997063 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.997030 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-sp6j4","openshift-multus/multus-j4pd8","openshift-multus/network-metrics-daemon-lpgzv","kube-system/konnectivity-agent-8w6q6","openshift-dns/node-resolver-n5lnc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal","openshift-network-diagnostics/network-check-target-gs9v6","openshift-network-operator/iptables-alerter-vs9ft","openshift-ovn-kubernetes/ovnkube-node-xws6g","kube-system/global-pull-secret-syncer-vh5lj","kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k","openshift-cluster-node-tuning-operator/tuned-dfkkp","openshift-image-registry/node-ca-fch8d"] Jul 22 15:12:51.998974 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:51.998953 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.001011 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.000991 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.001827 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.001801 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.002208 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.002189 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bgm58\"" Jul 22 15:12:52.002415 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.002394 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.003809 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.003879 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.003937 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.003960 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.003980 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.004008 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kkwkg\"" Jul 22 15:12:52.004110 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.004081 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.004544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.004525 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.005817 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.005798 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.007230 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vzwgv\"" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.007373 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.007237 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.007717 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.008270 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.008324 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.008512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.008497 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z9fpd\"" Jul 22 15:12:52.009261 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.009152 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:52.009261 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.009218 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.009736 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.010123 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.010347 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.010370 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2db9b\"" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.011983 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.012443 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.012464 2542 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 15:12:52.013739 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.013660 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.014497 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.013779 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.014961 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015009 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27c8b\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.014967 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015217 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015354 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015522 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s6tnt\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015695 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015860 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.015931 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.016111 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.016216 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.016543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.016360 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.024822 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024752 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.024822 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024803 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-netd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.024978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024875 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-systemd\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.024978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024919 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-var-lib-kubelet\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.024978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024954 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-etc-tuned\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.025135 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.024986 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-k8s-cni-cncf-io\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.025135 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025048 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-system-cni-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.025135 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025086 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-config\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025305 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025139 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovn-node-metrics-cert\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025305 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025221 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-sys-fs\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.025305 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025291 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-etc-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025325 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-log-socket\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025391 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysconfig\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.025568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025522 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-hostroot\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.025568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025554 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8nwt\" (UniqueName: \"kubernetes.io/projected/da458b9c-57c9-4d92-b354-b5fa06579eee-kube-api-access-c8nwt\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.025667 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025586 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-systemd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025667 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025622 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.025794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025650 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-modprobe-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.025794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025692 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-host\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.025794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025721 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltsh5\" (UniqueName: \"kubernetes.io/projected/58a0616a-15fc-4f06-959d-657eb8208542-kube-api-access-ltsh5\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.025794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025744 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-conf-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.025794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025770 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-daemon-config\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025798 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-tmp-dir\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025823 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-kubelet\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025853 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlf4\" (UniqueName: \"kubernetes.io/projected/8dab5927-df10-45fb-9ed4-61ec4d9994dd-kube-api-access-wvlf4\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025878 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025905 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-tmp\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025932 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-multus\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.025972 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fcb639a-e28d-4254-8630-5c70864f68c2-konnectivity-ca\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.026394 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026269 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-hosts-file\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.026446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026434 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwb4\" (UniqueName: \"kubernetes.io/projected/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-kube-api-access-dmwb4\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.026490 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026468 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dglvg\" (UniqueName: \"kubernetes.io/projected/2f9cebe6-2201-4395-9989-8bf8a15fddcd-kube-api-access-dglvg\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.026538 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026500 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkz95\" (UniqueName: \"kubernetes.io/projected/620b0e5f-605f-40f9-86ef-f651434a0be6-kube-api-access-qkz95\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.026583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026524 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-kubernetes\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.026583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026566 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-run\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.026671 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026610 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-lib-modules\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026671 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-system-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026699 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026731 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-socket-dir-parent\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026763 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-bin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026795 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-multus-certs\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026828 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.026883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026856 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862kr\" (UniqueName: \"kubernetes.io/projected/7c21c649-f879-4bbb-90cd-f76c135fb773-kube-api-access-862kr\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026890 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026938 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.026981 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-ovn\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027015 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027061 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-conf\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027091 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-netns\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027120 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027153 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-env-overrides\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027187 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-socket-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.027244 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027222 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-os-release\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027254 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-kubelet-config\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027281 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-netns\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027317 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-os-release\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027349 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-etc-kubernetes\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027382 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-node-log\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027408 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-script-lib\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027440 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-device-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027473 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-cnibin\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027536 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027590 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f9cebe6-2201-4395-9989-8bf8a15fddcd-host\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027636 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f9cebe6-2201-4395-9989-8bf8a15fddcd-serviceca\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.027809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.027663 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-slash\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028170 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028250 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-bin\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028297 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-registration-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028323 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cnibin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028342 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fcb639a-e28d-4254-8630-5c70864f68c2-agent-certs\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028357 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-dbus\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.028395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028374 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-systemd-units\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028399 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-var-lib-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028523 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-sys\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028543 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-kubelet\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028566 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028589 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028609 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028631 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cni-binary-copy\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.028876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.028652 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2qk\" (UniqueName: \"kubernetes.io/projected/0316e754-d7fc-43fa-8dc6-c3851a0d8195-kube-api-access-cj2qk\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.029322 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029227 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.029322 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029280 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgdm9\"" Jul 22 15:12:52.029487 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029461 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 15:12:52.029558 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029227 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:12:52.029679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029661 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.029810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029703 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 15:12:52.029893 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029859 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 15:12:52.030039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.029972 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pc9v4\"" Jul 22 15:12:52.038458 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.037558 2542 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 15:12:52.061664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.061638 2542 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4gmf" Jul 22 15:12:52.072076 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.072012 2542 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4gmf" Jul 22 15:12:52.113331 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.113270 2542 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 15:12:52.128855 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128827 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128869 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-ovn\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128895 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06fea4d-f37f-4daf-b5b5-54a85db338ee-host-slash\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128912 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgrv\" (UniqueName: \"kubernetes.io/projected/b06fea4d-f37f-4daf-b5b5-54a85db338ee-kube-api-access-rhgrv\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128938 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128962 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-conf\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128972 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-ovn\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.128991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.128987 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-netns\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129012 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129035 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-env-overrides\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129057 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-socket-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129098 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-os-release\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129124 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-kubelet-config\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129149 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-netns\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129174 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-os-release\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129196 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-etc-kubernetes\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129221 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-node-log\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129257 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-script-lib\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129289 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129280 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-device-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129313 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-cnibin\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129341 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129365 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f9cebe6-2201-4395-9989-8bf8a15fddcd-host\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129398 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f9cebe6-2201-4395-9989-8bf8a15fddcd-serviceca\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129423 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-slash\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129468 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129495 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-bin\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129522 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-registration-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129551 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cnibin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129575 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fcb639a-e28d-4254-8630-5c70864f68c2-agent-certs\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129613 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-dbus\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.129655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129639 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-systemd-units\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129666 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-var-lib-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129691 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-sys\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129750 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-kubelet\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129776 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129804 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129830 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129836 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129856 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cni-binary-copy\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129879 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2qk\" (UniqueName: \"kubernetes.io/projected/0316e754-d7fc-43fa-8dc6-c3851a0d8195-kube-api-access-cj2qk\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129904 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129926 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-netd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129947 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-systemd\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129971 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-var-lib-kubelet\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129982 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-conf\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130013 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-etc-tuned\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130042 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-k8s-cni-cncf-io\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.130250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130035 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-var-lib-kubelet\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130075 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-system-cni-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130102 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-config\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130128 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovn-node-metrics-cert\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130154 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-socket-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130155 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-sys-fs\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130201 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b06fea4d-f37f-4daf-b5b5-54a85db338ee-iptables-alerter-script\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130207 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-sys-fs\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130230 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-etc-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130252 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-netns\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130274 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-log-socket\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130301 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysconfig\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130328 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-hostroot\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.130348 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130353 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8nwt\" (UniqueName: \"kubernetes.io/projected/da458b9c-57c9-4d92-b354-b5fa06579eee-kube-api-access-c8nwt\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130380 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-systemd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.130429 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:52.630399448 +0000 UTC m=+2.990481683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:52.131096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130448 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130478 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-modprobe-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130503 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-host\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130539 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsh5\" (UniqueName: \"kubernetes.io/projected/58a0616a-15fc-4f06-959d-657eb8208542-kube-api-access-ltsh5\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130568 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-conf-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130590 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-k8s-cni-cncf-io\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130609 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-daemon-config\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130639 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-tmp-dir\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130668 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-kubelet\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130694 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlf4\" (UniqueName: \"kubernetes.io/projected/8dab5927-df10-45fb-9ed4-61ec4d9994dd-kube-api-access-wvlf4\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130744 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130771 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-tmp\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130799 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-multus\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130825 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fcb639a-e28d-4254-8630-5c70864f68c2-konnectivity-ca\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130855 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-hosts-file\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130884 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwb4\" (UniqueName: \"kubernetes.io/projected/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-kube-api-access-dmwb4\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130911 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dglvg\" (UniqueName: \"kubernetes.io/projected/2f9cebe6-2201-4395-9989-8bf8a15fddcd-kube-api-access-dglvg\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.131884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130938 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkz95\" (UniqueName: \"kubernetes.io/projected/620b0e5f-605f-40f9-86ef-f651434a0be6-kube-api-access-qkz95\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130968 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-kubernetes\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130998 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-run\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131026 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-lib-modules\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131054 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-system-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131082 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131110 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-socket-dir-parent\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131116 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-config\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131143 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-bin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131170 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-multus-certs\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131199 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131227 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862kr\" (UniqueName: \"kubernetes.io/projected/7c21c649-f879-4bbb-90cd-f76c135fb773-kube-api-access-862kr\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131258 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.131383 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131427 2542 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.131444 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:12:52.63142697 +0000 UTC m=+2.991509201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131504 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-os-release\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.132627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131553 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-kubelet-config\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131594 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-netns\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131652 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-os-release\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131690 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-etc-kubernetes\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.131740 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-node-log\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132193 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovnkube-script-lib\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132254 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-device-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132284 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-cnibin\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132626 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-systemd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132674 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132708 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f9cebe6-2201-4395-9989-8bf8a15fddcd-host\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132734 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132833 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-modprobe-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.132874 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-host\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133166 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f9cebe6-2201-4395-9989-8bf8a15fddcd-serviceca\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133232 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-slash\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133329 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133376 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-bin\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.133521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133429 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620b0e5f-605f-40f9-86ef-f651434a0be6-registration-dir\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133484 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cnibin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133521 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-conf-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133658 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/034c6996-5ef8-4346-b9d1-57d3f994ed05-dbus\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133882 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-run-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133916 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-run\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.129750 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dab5927-df10-45fb-9ed4-61ec4d9994dd-env-overrides\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133934 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-run-multus-certs\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.133962 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-kubernetes\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134004 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-var-lib-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134015 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-systemd-units\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134053 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-lib-modules\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134055 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134111 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-bin\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134117 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-system-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134065 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-sys\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134123 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-socket-dir-parent\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134161 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-etc-openvswitch\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.134432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134187 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-cni-netd\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134221 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-cni-dir\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134237 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-multus-daemon-config\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.130639 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c21c649-f879-4bbb-90cd-f76c135fb773-system-cni-dir\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134294 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-hostroot\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134310 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-log-socket\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134311 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-systemd\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134263 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134378 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysconfig\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134404 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a0616a-15fc-4f06-959d-657eb8208542-etc-sysctl-d\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134420 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dab5927-df10-45fb-9ed4-61ec4d9994dd-host-kubelet\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134467 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-cni-multus\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134507 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0316e754-d7fc-43fa-8dc6-c3851a0d8195-host-var-lib-kubelet\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134556 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0316e754-d7fc-43fa-8dc6-c3851a0d8195-cni-binary-copy\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134613 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134624 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-hosts-file\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134615 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c21c649-f879-4bbb-90cd-f76c135fb773-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.134742 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-tmp-dir\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.135360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.135070 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fcb639a-e28d-4254-8630-5c70864f68c2-konnectivity-ca\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.136333 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.136212 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:12:52.136333 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.136236 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:12:52.136333 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.136249 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:52.136333 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.136308 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:52.636288693 +0000 UTC m=+2.996370945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:52.138883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.137137 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-etc-tuned\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.138883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.137227 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dab5927-df10-45fb-9ed4-61ec4d9994dd-ovn-node-metrics-cert\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.138883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.137752 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a0616a-15fc-4f06-959d-657eb8208542-tmp\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.138883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.138567 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fcb639a-e28d-4254-8630-5c70864f68c2-agent-certs\") pod \"konnectivity-agent-8w6q6\" (UID: \"7fcb639a-e28d-4254-8630-5c70864f68c2\") " pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.147841 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsh5\" (UniqueName: \"kubernetes.io/projected/58a0616a-15fc-4f06-959d-657eb8208542-kube-api-access-ltsh5\") pod \"tuned-dfkkp\" (UID: \"58a0616a-15fc-4f06-959d-657eb8208542\") " pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.149237 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862kr\" (UniqueName: \"kubernetes.io/projected/7c21c649-f879-4bbb-90cd-f76c135fb773-kube-api-access-862kr\") pod \"multus-additional-cni-plugins-sp6j4\" (UID: \"7c21c649-f879-4bbb-90cd-f76c135fb773\") " pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.149968 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwb4\" (UniqueName: \"kubernetes.io/projected/3a7cb4f1-f769-49d9-bf11-bf06d3457ba7-kube-api-access-dmwb4\") pod \"node-resolver-n5lnc\" (UID: \"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7\") " pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.152385 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dglvg\" (UniqueName: \"kubernetes.io/projected/2f9cebe6-2201-4395-9989-8bf8a15fddcd-kube-api-access-dglvg\") pod \"node-ca-fch8d\" (UID: \"2f9cebe6-2201-4395-9989-8bf8a15fddcd\") " pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.152406 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlf4\" (UniqueName: \"kubernetes.io/projected/8dab5927-df10-45fb-9ed4-61ec4d9994dd-kube-api-access-wvlf4\") pod \"ovnkube-node-xws6g\" (UID: \"8dab5927-df10-45fb-9ed4-61ec4d9994dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.153744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.152854 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8nwt\" (UniqueName: \"kubernetes.io/projected/da458b9c-57c9-4d92-b354-b5fa06579eee-kube-api-access-c8nwt\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.155613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.154571 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2qk\" (UniqueName: \"kubernetes.io/projected/0316e754-d7fc-43fa-8dc6-c3851a0d8195-kube-api-access-cj2qk\") pod \"multus-j4pd8\" (UID: \"0316e754-d7fc-43fa-8dc6-c3851a0d8195\") " pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.155613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.154913 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkz95\" (UniqueName: \"kubernetes.io/projected/620b0e5f-605f-40f9-86ef-f651434a0be6-kube-api-access-qkz95\") pod \"aws-ebs-csi-driver-node-hcc4k\" (UID: \"620b0e5f-605f-40f9-86ef-f651434a0be6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.232306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.232272 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b06fea4d-f37f-4daf-b5b5-54a85db338ee-iptables-alerter-script\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.232524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.232363 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06fea4d-f37f-4daf-b5b5-54a85db338ee-host-slash\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.232524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.232389 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgrv\" (UniqueName: \"kubernetes.io/projected/b06fea4d-f37f-4daf-b5b5-54a85db338ee-kube-api-access-rhgrv\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.232524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.232500 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b06fea4d-f37f-4daf-b5b5-54a85db338ee-host-slash\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.232944 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.232923 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b06fea4d-f37f-4daf-b5b5-54a85db338ee-iptables-alerter-script\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.242048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.242021 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgrv\" (UniqueName: \"kubernetes.io/projected/b06fea4d-f37f-4daf-b5b5-54a85db338ee-kube-api-access-rhgrv\") pod \"iptables-alerter-vs9ft\" (UID: \"b06fea4d-f37f-4daf-b5b5-54a85db338ee\") " pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.316027 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.315988 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" Jul 22 15:12:52.331760 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.331736 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4pd8" Jul 22 15:12:52.342828 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.342798 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" Jul 22 15:12:52.350573 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.350554 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n5lnc" Jul 22 15:12:52.361336 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.361312 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fch8d" Jul 22 15:12:52.369153 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.369097 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:12:52.379946 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.379918 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:12:52.388004 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.387985 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" Jul 22 15:12:52.394900 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.394880 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs9ft" Jul 22 15:12:52.636112 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.636013 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:52.636112 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.636073 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:52.636356 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.636167 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:52.636356 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.636201 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:52.636356 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.636247 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:12:53.636225051 +0000 UTC m=+3.996307297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:52.636356 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.636285 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:53.636276155 +0000 UTC m=+3.996358383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:52.736566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:52.736513 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:52.736775 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.736750 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:12:52.736844 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.736777 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:12:52.736844 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.736794 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:52.736954 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:52.736882 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:53.736860043 +0000 UTC m=+4.096942296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:53.075615 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.075522 2542 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 15:07:52 +0000 UTC" deadline="2028-02-12 20:23:53.389180425 +0000 UTC" Jul 22 15:12:53.075615 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.075556 2542 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13685h11m0.313627643s" Jul 22 15:12:53.115971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.115921 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:53.116147 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.116075 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:12:53.229259 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.228839 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcb639a_e28d_4254_8630_5c70864f68c2.slice/crio-ade6690ac3c0d81e8f519664f8806a567ce912c102dbb44a70918a33f7a20c5d WatchSource:0}: Error finding container ade6690ac3c0d81e8f519664f8806a567ce912c102dbb44a70918a33f7a20c5d: Status 404 returned error can't find the container with id ade6690ac3c0d81e8f519664f8806a567ce912c102dbb44a70918a33f7a20c5d Jul 22 15:12:53.231190 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.231162 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a0616a_15fc_4f06_959d_657eb8208542.slice/crio-9438bbd213ea943c068ad3372f5aac32a63489c9e87440487eca0d915fa45c51 WatchSource:0}: Error finding container 9438bbd213ea943c068ad3372f5aac32a63489c9e87440487eca0d915fa45c51: Status 404 returned error can't find the container with id 9438bbd213ea943c068ad3372f5aac32a63489c9e87440487eca0d915fa45c51 Jul 22 15:12:53.233043 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.232829 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9cebe6_2201_4395_9989_8bf8a15fddcd.slice/crio-79108d37f19d7f3c514c4859599b359d3d8d69d2cb00c5f68ac4d69b55682942 WatchSource:0}: Error finding container 79108d37f19d7f3c514c4859599b359d3d8d69d2cb00c5f68ac4d69b55682942: Status 404 returned error can't find the container with id 79108d37f19d7f3c514c4859599b359d3d8d69d2cb00c5f68ac4d69b55682942 Jul 22 15:12:53.238939 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.238909 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dab5927_df10_45fb_9ed4_61ec4d9994dd.slice/crio-19080602b76cab9d695563d6b9d8443cb025efaba25a8492a74489a33d8c8d69 WatchSource:0}: Error finding container 19080602b76cab9d695563d6b9d8443cb025efaba25a8492a74489a33d8c8d69: Status 404 returned error can't find the container with id 19080602b76cab9d695563d6b9d8443cb025efaba25a8492a74489a33d8c8d69 Jul 22 15:12:53.239908 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.239883 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06fea4d_f37f_4daf_b5b5_54a85db338ee.slice/crio-0e72af47237dd8c21aec420fe9a9544a3c330138afe4b4b8b40fbacd1b284004 WatchSource:0}: Error finding container 0e72af47237dd8c21aec420fe9a9544a3c330138afe4b4b8b40fbacd1b284004: Status 404 returned error can't find the container with id 0e72af47237dd8c21aec420fe9a9544a3c330138afe4b4b8b40fbacd1b284004 Jul 22 15:12:53.243259 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.242038 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0316e754_d7fc_43fa_8dc6_c3851a0d8195.slice/crio-485cf78cb852997336ba9c8df8a0bb36e029b28375e7c7b042356e60015047ec WatchSource:0}: Error finding container 485cf78cb852997336ba9c8df8a0bb36e029b28375e7c7b042356e60015047ec: Status 404 returned error can't find the container with id 485cf78cb852997336ba9c8df8a0bb36e029b28375e7c7b042356e60015047ec Jul 22 15:12:53.243259 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.242522 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620b0e5f_605f_40f9_86ef_f651434a0be6.slice/crio-62782433c7925bcb16d886653fed8a7eebde762aac7c960b2f7c39086d26cf43 WatchSource:0}: Error finding container 62782433c7925bcb16d886653fed8a7eebde762aac7c960b2f7c39086d26cf43: Status 404 returned error can't find the container with id 62782433c7925bcb16d886653fed8a7eebde762aac7c960b2f7c39086d26cf43 Jul 22 15:12:53.244951 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.244784 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c21c649_f879_4bbb_90cd_f76c135fb773.slice/crio-2c58c1bf513442204e00e911b9dc6e5c56e308e94dd97ff2d583da0f08d225b9 WatchSource:0}: Error finding container 2c58c1bf513442204e00e911b9dc6e5c56e308e94dd97ff2d583da0f08d225b9: Status 404 returned error can't find the container with id 2c58c1bf513442204e00e911b9dc6e5c56e308e94dd97ff2d583da0f08d225b9 Jul 22 15:12:53.245947 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:12:53.245392 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7cb4f1_f769_49d9_bf11_bf06d3457ba7.slice/crio-5c1d456c26cdef700339bbc9892545625bd0b7f96f1660b7b350120f0e10d8a7 WatchSource:0}: Error finding container 5c1d456c26cdef700339bbc9892545625bd0b7f96f1660b7b350120f0e10d8a7: Status 404 returned error can't find the container with id 5c1d456c26cdef700339bbc9892545625bd0b7f96f1660b7b350120f0e10d8a7 Jul 22 15:12:53.643379 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.643110 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:53.643561 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.643429 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:53.643561 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.643239 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:53.643673 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.643587 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:53.643673 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.643652 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:55.643632348 +0000 UTC m=+6.003714592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:53.643796 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.643701 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:12:55.643676418 +0000 UTC m=+6.003758672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:53.744111 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:53.744013 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:53.744269 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.744230 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:12:53.744269 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.744258 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:12:53.744381 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.744273 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:53.744381 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:53.744342 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:55.744321212 +0000 UTC m=+6.104403443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:54.076483 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.076356 2542 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 15:07:52 +0000 UTC" deadline="2028-02-03 09:10:50.824834768 +0000 UTC" Jul 22 15:12:54.076483 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.076421 2542 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13457h57m56.748417374s" Jul 22 15:12:54.118551 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.118519 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:54.118765 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:54.118666 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:12:54.118858 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.118782 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:54.118917 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:54.118865 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:12:54.140352 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.140302 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" event={"ID":"620b0e5f-605f-40f9-86ef-f651434a0be6","Type":"ContainerStarted","Data":"62782433c7925bcb16d886653fed8a7eebde762aac7c960b2f7c39086d26cf43"} Jul 22 15:12:54.152533 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.152491 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" event={"ID":"58a0616a-15fc-4f06-959d-657eb8208542","Type":"ContainerStarted","Data":"9438bbd213ea943c068ad3372f5aac32a63489c9e87440487eca0d915fa45c51"} Jul 22 15:12:54.156452 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.156400 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs9ft" event={"ID":"b06fea4d-f37f-4daf-b5b5-54a85db338ee","Type":"ContainerStarted","Data":"0e72af47237dd8c21aec420fe9a9544a3c330138afe4b4b8b40fbacd1b284004"} Jul 22 15:12:54.164007 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.163930 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4pd8" event={"ID":"0316e754-d7fc-43fa-8dc6-c3851a0d8195","Type":"ContainerStarted","Data":"485cf78cb852997336ba9c8df8a0bb36e029b28375e7c7b042356e60015047ec"} Jul 22 15:12:54.167446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.167415 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n5lnc" event={"ID":"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7","Type":"ContainerStarted","Data":"5c1d456c26cdef700339bbc9892545625bd0b7f96f1660b7b350120f0e10d8a7"} Jul 22 15:12:54.190368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.190330 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"19080602b76cab9d695563d6b9d8443cb025efaba25a8492a74489a33d8c8d69"} Jul 22 15:12:54.198940 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.198903 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fch8d" event={"ID":"2f9cebe6-2201-4395-9989-8bf8a15fddcd","Type":"ContainerStarted","Data":"79108d37f19d7f3c514c4859599b359d3d8d69d2cb00c5f68ac4d69b55682942"} Jul 22 15:12:54.214519 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.214485 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8w6q6" event={"ID":"7fcb639a-e28d-4254-8630-5c70864f68c2","Type":"ContainerStarted","Data":"ade6690ac3c0d81e8f519664f8806a567ce912c102dbb44a70918a33f7a20c5d"} Jul 22 15:12:54.233544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.232435 2542 generic.go:356] "Generic (PLEG): container finished" podID="e6a0275174239c1505375b9fbc7c088a" containerID="fbdf3263a8bb8a93894f62d1f4d47ec2a328c6dd214798236ab41f8beb406002" exitCode=0 Jul 22 15:12:54.233544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.232534 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" event={"ID":"e6a0275174239c1505375b9fbc7c088a","Type":"ContainerDied","Data":"fbdf3263a8bb8a93894f62d1f4d47ec2a328c6dd214798236ab41f8beb406002"} Jul 22 15:12:54.240372 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.240341 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" event={"ID":"22335277600545a94aa18b4597eb4b80","Type":"ContainerStarted","Data":"656f5ff03f5ff352933e10210f79281fd58ba06937e3416fdea6fdda7d9c83f1"} Jul 22 15:12:54.245320 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:54.245236 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerStarted","Data":"2c58c1bf513442204e00e911b9dc6e5c56e308e94dd97ff2d583da0f08d225b9"} Jul 22 15:12:55.116654 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.116619 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:55.117224 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.116782 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:12:55.256934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.256774 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" event={"ID":"e6a0275174239c1505375b9fbc7c088a","Type":"ContainerStarted","Data":"2c0bccdff001a74d9a79c89b8d7a7412d42cac73f427b0901a61b09e5dcacc1e"} Jul 22 15:12:55.274967 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.274902 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-36.ec2.internal" podStartSLOduration=4.274879322 podStartE2EDuration="4.274879322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:12:54.266874031 +0000 UTC m=+4.626956284" watchObservedRunningTime="2026-07-22 15:12:55.274879322 +0000 UTC m=+5.634961576" Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.657192 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.657283 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.657476 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.657571 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.657551064 +0000 UTC m=+10.017633310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.657982 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:55.658063 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.658031 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.658015191 +0000 UTC m=+10.018097435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:55.758429 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:55.758265 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:55.758747 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.758480 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:12:55.758747 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.758506 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:12:55.758747 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.758520 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:55.758747 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:55.758582 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.758562708 +0000 UTC m=+10.118644940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:56.116270 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:56.115649 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:56.116270 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:56.115798 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:12:56.116270 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:56.115845 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:56.116270 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:56.115965 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:12:57.116161 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:57.116118 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:57.116568 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:57.116278 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:12:58.116162 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:58.116118 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:58.116634 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:58.116254 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:12:58.116736 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:58.116721 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:58.116884 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:58.116844 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:12:59.117420 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:59.116730 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:59.117420 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.116921 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:59.694052 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:59.694121 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.694247 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.694313 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:07.694292712 +0000 UTC m=+18.054374942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.694752 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:59.694835 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.694809 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:13:07.694792912 +0000 UTC m=+18.054875145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:12:59.795517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:12:59.794938 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:12:59.795517 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.795114 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:12:59.795517 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.795135 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:12:59.795517 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.795149 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:12:59.795517 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:12:59.795207 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:07.795189453 +0000 UTC m=+18.155271705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:13:00.120171 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:00.120074 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:00.120602 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:00.120194 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:00.120602 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:00.120591 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:00.120760 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:00.120706 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:01.116566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:01.116530 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:01.116758 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:01.116677 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:02.119477 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:02.119445 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:02.119898 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:02.119590 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:02.119898 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:02.119658 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:02.119898 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:02.119777 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:03.116012 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:03.115974 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:03.116205 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:03.116116 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:04.116195 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:04.116159 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:04.116606 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:04.116289 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:04.116606 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:04.116355 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:04.116606 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:04.116474 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:05.116133 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:05.116099 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:05.116312 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:05.116201 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:06.119679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:06.119629 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:06.119679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:06.119670 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:06.120142 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:06.119768 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:06.120142 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:06.119854 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:07.115917 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:07.115888 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:07.116115 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.116002 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:07.758464 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:07.758432 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:07.759013 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:07.758511 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:07.759013 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.758605 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:13:07.759013 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.758625 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:13:07.759013 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.758694 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:23.758674188 +0000 UTC m=+34.118756431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:13:07.759013 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.758713 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:13:23.758704748 +0000 UTC m=+34.118786975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:13:07.858998 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:07.858959 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:07.859159 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.859127 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:13:07.859159 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.859154 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:13:07.859322 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.859168 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:13:07.859322 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:07.859230 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:23.859210931 +0000 UTC m=+34.219293181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:13:08.116516 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:08.116433 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:08.116706 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:08.116562 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:08.116706 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:08.116581 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:08.116838 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:08.116701 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:09.116245 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:09.116215 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:09.116630 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:09.116326 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:10.117084 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:10.117049 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:10.117498 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:10.117091 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:10.117498 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:10.117157 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:10.117498 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:10.117300 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:11.116563 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:11.116524 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:11.116757 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:11.116714 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:12.116566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:12.116534 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:12.117028 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:12.116682 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:12.117028 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:12.116534 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:12.117164 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:12.117140 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:13.116931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.116432 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:13.116931 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:13.116788 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:13.293574 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.293541 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n5lnc" event={"ID":"3a7cb4f1-f769-49d9-bf11-bf06d3457ba7","Type":"ContainerStarted","Data":"76a450354d172e04b2a1771d7b1c5833da5293292f87945d1cacc240b5ba7134"} Jul 22 15:13:13.295934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.295808 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"4775dff68776d4baa51460e338a916f95038562b5bcb4ce0bff7dbe1d563ff10"} Jul 22 15:13:13.295934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.295909 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"63fc4730a129bb81eb45d1c1746ad0a963880e9c64c00be82e0161a0c2915cd9"} Jul 22 15:13:13.296053 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.295979 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"20fe0f949138bb028ab0e6105cd07d445394e65d52a1fbf2802b1263c2c8021b"} Jul 22 15:13:13.296053 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.296023 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"5ab316383102d75907eeac04b9408d81037a011c5d3e77e876134c7b25d7507c"} Jul 22 15:13:13.297795 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.297774 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fch8d" event={"ID":"2f9cebe6-2201-4395-9989-8bf8a15fddcd","Type":"ContainerStarted","Data":"bdee93f7fdc90f9bc7bd4da0f4fd353e8e820f9d71dfcab6739af07cf91426f5"} Jul 22 15:13:13.299129 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.299108 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8w6q6" event={"ID":"7fcb639a-e28d-4254-8630-5c70864f68c2","Type":"ContainerStarted","Data":"47b5ed2eabea664dd9bf80901cd4c6f0a64ae32691648a76a1cbf89d69e15f0c"} Jul 22 15:13:13.300462 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.300440 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="c2036b7e3cdb02348ec41a1f58b9bc20f49f2b05133d1998fa347cb173fb0cfd" exitCode=0 Jul 22 15:13:13.300555 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.300493 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"c2036b7e3cdb02348ec41a1f58b9bc20f49f2b05133d1998fa347cb173fb0cfd"} Jul 22 15:13:13.302096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.302076 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" event={"ID":"620b0e5f-605f-40f9-86ef-f651434a0be6","Type":"ContainerStarted","Data":"2953b898dfb7b5b53e2c036094f21c6e5c278bc9eeae4b3e41b1eb72b9d96cf7"} Jul 22 15:13:13.304184 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.304167 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" event={"ID":"58a0616a-15fc-4f06-959d-657eb8208542","Type":"ContainerStarted","Data":"aff0c99b034ae45bff5aa65e5314164a31a843498038c73ad8b136d7b1595652"} Jul 22 15:13:13.305700 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.305676 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4pd8" event={"ID":"0316e754-d7fc-43fa-8dc6-c3851a0d8195","Type":"ContainerStarted","Data":"01f61dbaffaeb25010a9ff7a80841d15566aaebd5c0d4934c6e4e242e710a7d1"} Jul 22 15:13:13.308206 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.308169 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n5lnc" podStartSLOduration=3.807765013 podStartE2EDuration="23.308158036s" totalImagesPullingTime="19.500393023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:13.307713325 +0000 UTC m=+23.667795574" watchObservedRunningTime="2026-07-22 15:13:13.308158036 +0000 UTC m=+23.668240284" Jul 22 15:13:13.308316 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.308249 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-36.ec2.internal" podStartSLOduration=22.308241683 podStartE2EDuration="22.308241683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:12:55.275839557 +0000 UTC m=+5.635921824" watchObservedRunningTime="2026-07-22 15:13:13.308241683 +0000 UTC m=+23.668323933" Jul 22 15:13:13.323357 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.323323 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8w6q6" podStartSLOduration=7.017477711 podStartE2EDuration="22.323311571s" totalImagesPullingTime="15.30583386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:13.3230677 +0000 UTC m=+23.683149948" watchObservedRunningTime="2026-07-22 15:13:13.323311571 +0000 UTC m=+23.683393820" Jul 22 15:13:13.348670 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.348620 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dfkkp" podStartSLOduration=3.830391719 podStartE2EDuration="23.348608816s" totalImagesPullingTime="19.518217097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:13.34803063 +0000 UTC m=+23.708112878" watchObservedRunningTime="2026-07-22 15:13:13.348608816 +0000 UTC m=+23.708691065" Jul 22 15:13:13.367048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.366941 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j4pd8" podStartSLOduration=3.8389397990000003 podStartE2EDuration="23.366928036s" totalImagesPullingTime="19.527988237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:13.366467395 +0000 UTC m=+23.726549645" watchObservedRunningTime="2026-07-22 15:13:13.366928036 +0000 UTC m=+23.727010284" Jul 22 15:13:13.880605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.880568 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:13:13.881189 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.881168 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:13:13.896007 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:13.895966 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fch8d" podStartSLOduration=4.405988406 podStartE2EDuration="23.895951584s" totalImagesPullingTime="19.489963178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:13.41549296 +0000 UTC m=+23.775575211" watchObservedRunningTime="2026-07-22 15:13:13.895951584 +0000 UTC m=+24.256033834" Jul 22 15:13:14.116905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.116380 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:14.116905 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:14.116515 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:14.116905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.116585 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:14.116905 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:14.116720 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:14.223340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.223315 2542 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 15:13:14.309501 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.309425 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" event={"ID":"620b0e5f-605f-40f9-86ef-f651434a0be6","Type":"ContainerStarted","Data":"df8d06a06dc93204d85fab4a49226d0c8bc575212ff08d06ab65dd2a08f579e4"} Jul 22 15:13:14.310927 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.310900 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs9ft" event={"ID":"b06fea4d-f37f-4daf-b5b5-54a85db338ee","Type":"ContainerStarted","Data":"14c1c7a277c5ca7a9fd3f060ba6d144b3305c850fda048fcd13b369ca39d2516"} Jul 22 15:13:14.314607 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.314486 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"d54852ba4aa4e4b9b8ac9980ff3a7f01d99b36a72a66f597d9a1a82f64a4b122"} Jul 22 15:13:14.314607 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.314562 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"e2820c557de32c54d18423d3b430db37bdeb440dd3b81f829427a13be8e94e77"} Jul 22 15:13:14.314807 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.314785 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:13:14.315415 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.315396 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8w6q6" Jul 22 15:13:14.324680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:14.324627 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vs9ft" podStartSLOduration=3.845129461 podStartE2EDuration="23.324611515s" totalImagesPullingTime="19.479482054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:14.324603974 +0000 UTC m=+24.684686224" watchObservedRunningTime="2026-07-22 15:13:14.324611515 +0000 UTC m=+24.684693756" Jul 22 15:13:15.089220 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:15.089123 2542 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T15:13:14.223338184Z","UUID":"e86aebaa-e2cf-41a6-8c46-d273b9a7511f","Handler":null,"Name":"","Endpoint":""} Jul 22 15:13:15.090937 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:15.090915 2542 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 15:13:15.091066 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:15.090964 2542 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 15:13:15.115714 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:15.115682 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:15.115825 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:15.115800 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:16.115949 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:16.115924 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:16.116316 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:16.116055 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:16.116316 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:16.116099 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:16.116316 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:16.116204 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:16.322625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:16.322577 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"690e6f4811d4d6a1e2cbdc3feeabbfba551e301d209ade13d6221f1b5cea45cd"} Jul 22 15:13:16.324836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:16.324800 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" event={"ID":"620b0e5f-605f-40f9-86ef-f651434a0be6","Type":"ContainerStarted","Data":"424e81b0caa574867a8630140e554b2de43c2a9886e652b8b2de154c43799457"} Jul 22 15:13:16.344891 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:16.344820 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcc4k" podStartSLOduration=2.931382586 podStartE2EDuration="25.344805992s" totalImagesPullingTime="22.413423406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:16.344355297 +0000 UTC m=+26.704437545" watchObservedRunningTime="2026-07-22 15:13:16.344805992 +0000 UTC m=+26.704888238" Jul 22 15:13:17.116321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:17.116291 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:17.116830 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:17.116422 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:18.116582 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.116340 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:18.116582 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.116405 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:18.116582 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:18.116594 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:18.117238 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:18.116679 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:18.331546 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.331439 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="fb37537d12d060ed9453c21437ab1b6013e0442509d209fa99248e8bc73f42f7" exitCode=0 Jul 22 15:13:18.331546 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.331530 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"fb37537d12d060ed9453c21437ab1b6013e0442509d209fa99248e8bc73f42f7"} Jul 22 15:13:18.335281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.335259 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" event={"ID":"8dab5927-df10-45fb-9ed4-61ec4d9994dd","Type":"ContainerStarted","Data":"127edb309221c52e2b23748116f897b128bc350ea2bfdfcbfbdcf7b7743f061c"} Jul 22 15:13:18.335496 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.335476 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:18.335598 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.335538 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:18.335598 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.335573 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:18.351500 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.351478 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:18.351613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.351569 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:18.379489 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:18.379452 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" podStartSLOduration=7.784733863 podStartE2EDuration="27.379438594s" totalImagesPullingTime="19.594704731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:18.378825214 +0000 UTC m=+28.738907462" watchObservedRunningTime="2026-07-22 15:13:18.379438594 +0000 UTC m=+28.739520842" Jul 22 15:13:19.116319 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.116281 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:19.116508 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:19.116449 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:19.892614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.892534 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vh5lj"] Jul 22 15:13:19.893080 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.892756 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:19.893080 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:19.892843 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:19.896044 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.896018 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gs9v6"] Jul 22 15:13:19.896175 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.896120 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:19.896235 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:19.896195 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:19.896609 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.896585 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpgzv"] Jul 22 15:13:19.896721 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:19.896712 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:19.896833 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:19.896814 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:20.341589 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:20.341492 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="5a9b8bee8a737988c5411b91fc0d2dacc615efbeba5840e6d5efee87de291290" exitCode=0 Jul 22 15:13:20.341787 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:20.341580 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"5a9b8bee8a737988c5411b91fc0d2dacc615efbeba5840e6d5efee87de291290"} Jul 22 15:13:21.116279 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:21.116249 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:21.116737 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:21.116378 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:22.120462 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:22.119840 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:22.120462 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:22.120208 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:22.120983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:22.120741 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:22.120983 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:22.120857 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:22.358945 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:22.358869 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="7e15b7382bc91b3d6adf7d95b8998c0bf94f3d26b554a6005430dc9864a27239" exitCode=0 Jul 22 15:13:22.358945 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:22.358925 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"7e15b7382bc91b3d6adf7d95b8998c0bf94f3d26b554a6005430dc9864a27239"} Jul 22 15:13:23.116334 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:23.116301 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:23.116539 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.116447 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:23.785209 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:23.785266 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.785351 2542 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.785353 2542 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.785403 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret podName:034c6996-5ef8-4346-b9d1-57d3f994ed05 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:55.785391113 +0000 UTC m=+66.145473339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret") pod "global-pull-secret-syncer-vh5lj" (UID: "034c6996-5ef8-4346-b9d1-57d3f994ed05") : object "kube-system"/"original-pull-secret" not registered Jul 22 15:13:23.785459 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.785418 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs podName:da458b9c-57c9-4d92-b354-b5fa06579eee nodeName:}" failed. No retries permitted until 2026-07-22 15:13:55.785411122 +0000 UTC m=+66.145493349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs") pod "network-metrics-daemon-lpgzv" (UID: "da458b9c-57c9-4d92-b354-b5fa06579eee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 15:13:23.886377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:23.886339 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:23.886559 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.886526 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 15:13:23.886559 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.886555 2542 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 15:13:23.886703 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.886567 2542 projected.go:196] Error preparing data for projected volume kube-api-access-gpvhs for pod openshift-network-diagnostics/network-check-target-gs9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:13:23.886703 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:23.886649 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs podName:ab50bc25-28dd-44d6-86b8-d6182c65bb49 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:55.886615341 +0000 UTC m=+66.246697580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpvhs" (UniqueName: "kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs") pod "network-check-target-gs9v6" (UID: "ab50bc25-28dd-44d6-86b8-d6182c65bb49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 15:13:24.118228 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:24.117757 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:24.118228 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:24.117795 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:24.118228 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:24.117917 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gs9v6" podUID="ab50bc25-28dd-44d6-86b8-d6182c65bb49" Jul 22 15:13:24.118228 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:24.118012 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vh5lj" podUID="034c6996-5ef8-4346-b9d1-57d3f994ed05" Jul 22 15:13:25.116228 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.116195 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:25.116768 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.116334 2542 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpgzv" podUID="da458b9c-57c9-4d92-b354-b5fa06579eee" Jul 22 15:13:25.470186 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.470109 2542 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-36.ec2.internal" event="NodeReady" Jul 22 15:13:25.470344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.470253 2542 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 15:13:25.505679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.505626 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6"] Jul 22 15:13:25.508282 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.508257 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.508733 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.508702 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-679vz"] Jul 22 15:13:25.510226 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.510208 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.512250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.511962 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:13:25.512360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.512306 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 15:13:25.513385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.512766 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 15:13:25.513385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.512950 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 15:13:25.514867 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.514845 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6dx45\"" Jul 22 15:13:25.515060 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.515040 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb"] Jul 22 15:13:25.515174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.515149 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 15:13:25.515501 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.515486 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 15:13:25.515611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.515592 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tf8ct\"" Jul 22 15:13:25.516732 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.516713 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:13:25.516837 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.516807 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.518308 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.518290 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks"] Jul 22 15:13:25.518422 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.518404 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.518879 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.518857 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 15:13:25.519348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.519016 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 15:13:25.519348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.519242 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:13:25.519348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.519256 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 15:13:25.519348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.519266 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-drcnl\"" Jul 22 15:13:25.520057 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.520038 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zfmzk"] Jul 22 15:13:25.520166 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.520151 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" Jul 22 15:13:25.522424 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522407 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 15:13:25.522559 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522542 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.522604 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522555 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 15:13:25.522811 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522790 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 15:13:25.522933 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522918 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 15:13:25.523046 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.522407 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjvqb\"" Jul 22 15:13:25.523391 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.523373 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 15:13:25.523391 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.523388 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6d8pd\"" Jul 22 15:13:25.525156 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.525135 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 15:13:25.525445 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.525429 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j8ghg\"" Jul 22 15:13:25.525553 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.525536 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 15:13:25.527931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.527911 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 15:13:25.531435 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.531415 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6"] Jul 22 15:13:25.533754 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.533724 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-679vz"] Jul 22 15:13:25.533857 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.533777 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cr7gm"] Jul 22 15:13:25.535960 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.535944 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks"] Jul 22 15:13:25.536076 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.536060 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:13:25.536181 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.536029 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.538465 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.538446 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 15:13:25.538547 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.538479 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zx2fs\"" Jul 22 15:13:25.538772 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.538751 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 15:13:25.538951 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.538934 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 15:13:25.544237 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.544215 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb"] Jul 22 15:13:25.546359 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.546336 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cr7gm"] Jul 22 15:13:25.546462 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.546369 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zfmzk"] Jul 22 15:13:25.599155 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599118 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.599294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599163 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wp7\" (UniqueName: \"kubernetes.io/projected/10a7f95b-e941-4f24-a9a3-5ad298f3252d-kube-api-access-m8wp7\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.599294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599206 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efe62586-cb4c-4815-8680-0fa68b9d311b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.599294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599234 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d2g\" (UniqueName: \"kubernetes.io/projected/91dbb804-e5c1-49af-b55e-af3209f15a44-kube-api-access-x8d2g\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.599294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599263 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599291 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599315 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599337 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599376 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91dbb804-e5c1-49af-b55e-af3209f15a44-config\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599404 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6z5t\" (UniqueName: \"kubernetes.io/projected/efe62586-cb4c-4815-8680-0fa68b9d311b-kube-api-access-t6z5t\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599437 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599462 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a7f95b-e941-4f24-a9a3-5ad298f3252d-tmp-dir\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599493 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.599517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599516 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6h7\" (UniqueName: \"kubernetes.io/projected/45a0f4fb-6387-4683-823f-b95a10427c76-kube-api-access-rz6h7\") pod \"network-check-source-7bc5b6bf85-rf5ks\" (UID: \"45a0f4fb-6387-4683-823f-b95a10427c76\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599556 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efe62586-cb4c-4815-8680-0fa68b9d311b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599590 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91dbb804-e5c1-49af-b55e-af3209f15a44-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599676 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599704 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599722 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.599810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599794 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmxh\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.600044 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.599820 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10a7f95b-e941-4f24-a9a3-5ad298f3252d-config-volume\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.669888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.669838 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:25.700714 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700675 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700725 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6h7\" (UniqueName: \"kubernetes.io/projected/45a0f4fb-6387-4683-823f-b95a10427c76-kube-api-access-rz6h7\") pod \"network-check-source-7bc5b6bf85-rf5ks\" (UID: \"45a0f4fb-6387-4683-823f-b95a10427c76\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700754 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efe62586-cb4c-4815-8680-0fa68b9d311b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700778 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91dbb804-e5c1-49af-b55e-af3209f15a44-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700809 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.700828 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700836 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700867 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.700894 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.700894 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:26.200872785 +0000 UTC m=+36.560955011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700952 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmxh\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.700995 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10a7f95b-e941-4f24-a9a3-5ad298f3252d-config-volume\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701012 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701027 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wp7\" (UniqueName: \"kubernetes.io/projected/10a7f95b-e941-4f24-a9a3-5ad298f3252d-kube-api-access-m8wp7\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701049 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbxf6\" (UniqueName: \"kubernetes.io/projected/51160b4c-bb34-4a31-99ec-5230c597fc88-kube-api-access-vbxf6\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701078 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efe62586-cb4c-4815-8680-0fa68b9d311b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701102 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d2g\" (UniqueName: \"kubernetes.io/projected/91dbb804-e5c1-49af-b55e-af3209f15a44-kube-api-access-x8d2g\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701123 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51160b4c-bb34-4a31-99ec-5230c597fc88-cert\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701151 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701179 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701202 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701223 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701245 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91dbb804-e5c1-49af-b55e-af3209f15a44-config\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.701810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701267 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6z5t\" (UniqueName: \"kubernetes.io/projected/efe62586-cb4c-4815-8680-0fa68b9d311b-kube-api-access-t6z5t\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.701810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701304 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.701810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701332 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a7f95b-e941-4f24-a9a3-5ad298f3252d-tmp-dir\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.701810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701555 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.701810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.701667 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a7f95b-e941-4f24-a9a3-5ad298f3252d-tmp-dir\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.702481 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.702457 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.702712 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.702669 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10a7f95b-e941-4f24-a9a3-5ad298f3252d-config-volume\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.702712 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.702693 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:25.702901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.702752 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:26.202735833 +0000 UTC m=+36.562818073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:25.703425 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.703308 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91dbb804-e5c1-49af-b55e-af3209f15a44-config\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.703515 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.703460 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efe62586-cb4c-4815-8680-0fa68b9d311b-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.703574 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.703515 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:25.703574 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.703529 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:25.703574 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.703536 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:25.703755 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:25.703585 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:26.203567779 +0000 UTC m=+36.563650020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:25.703817 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.703784 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.706065 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.706041 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efe62586-cb4c-4815-8680-0fa68b9d311b-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.706156 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.706048 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.706156 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.706141 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.706276 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.706228 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91dbb804-e5c1-49af-b55e-af3209f15a44-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.709356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.709334 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6h7\" (UniqueName: \"kubernetes.io/projected/45a0f4fb-6387-4683-823f-b95a10427c76-kube-api-access-rz6h7\") pod \"network-check-source-7bc5b6bf85-rf5ks\" (UID: \"45a0f4fb-6387-4683-823f-b95a10427c76\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" Jul 22 15:13:25.713567 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.713535 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmxh\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.713756 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.713655 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d2g\" (UniqueName: \"kubernetes.io/projected/91dbb804-e5c1-49af-b55e-af3209f15a44-kube-api-access-x8d2g\") pod \"service-ca-operator-5bcbc94c78-t2mbb\" (UID: \"91dbb804-e5c1-49af-b55e-af3209f15a44\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.714256 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.714227 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6z5t\" (UniqueName: \"kubernetes.io/projected/efe62586-cb4c-4815-8680-0fa68b9d311b-kube-api-access-t6z5t\") pod \"kube-storage-version-migrator-operator-7658d9b749-zkwc6\" (UID: \"efe62586-cb4c-4815-8680-0fa68b9d311b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.714405 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.714381 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:25.714499 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.714459 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wp7\" (UniqueName: \"kubernetes.io/projected/10a7f95b-e941-4f24-a9a3-5ad298f3252d-kube-api-access-m8wp7\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:25.795751 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.795653 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:25.802680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.802631 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbxf6\" (UniqueName: \"kubernetes.io/projected/51160b4c-bb34-4a31-99ec-5230c597fc88-kube-api-access-vbxf6\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.802841 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.802700 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51160b4c-bb34-4a31-99ec-5230c597fc88-cert\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.805448 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.805427 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51160b4c-bb34-4a31-99ec-5230c597fc88-cert\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.815647 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.811556 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbxf6\" (UniqueName: \"kubernetes.io/projected/51160b4c-bb34-4a31-99ec-5230c597fc88-kube-api-access-vbxf6\") pod \"ingress-canary-cr7gm\" (UID: \"51160b4c-bb34-4a31-99ec-5230c597fc88\") " pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:25.825262 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.825231 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" Jul 22 15:13:25.842397 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.842367 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" Jul 22 15:13:25.858837 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.858808 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" Jul 22 15:13:25.872854 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:25.872827 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cr7gm" Jul 22 15:13:26.115868 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.115771 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:26.116030 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.116009 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:26.119648 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.119611 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glqml\"" Jul 22 15:13:26.119648 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.119620 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 15:13:26.206138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.206098 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.206169 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.206219 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206278 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206300 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206308 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:26.206330 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206316 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:26.206655 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206359 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:27.20634323 +0000 UTC m=+37.566425459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:26.206655 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206375 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:27.206369151 +0000 UTC m=+37.566451377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:26.206655 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:26.206385 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:27.20638001 +0000 UTC m=+37.566462236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:26.691223 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.690990 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6"] Jul 22 15:13:26.694543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.694222 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cr7gm"] Jul 22 15:13:26.696199 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:26.695928 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe62586_cb4c_4815_8680_0fa68b9d311b.slice/crio-6c135294ed228f5afd3bf551977b63463df467bb4e174f206566e553f6f1d43a WatchSource:0}: Error finding container 6c135294ed228f5afd3bf551977b63463df467bb4e174f206566e553f6f1d43a: Status 404 returned error can't find the container with id 6c135294ed228f5afd3bf551977b63463df467bb4e174f206566e553f6f1d43a Jul 22 15:13:26.699293 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:26.699211 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51160b4c_bb34_4a31_99ec_5230c597fc88.slice/crio-7e001a2dd33bf5c925446dde88c0c0f1ae4bc221f196f61241c3aa3fb4bb9ec4 WatchSource:0}: Error finding container 7e001a2dd33bf5c925446dde88c0c0f1ae4bc221f196f61241c3aa3fb4bb9ec4: Status 404 returned error can't find the container with id 7e001a2dd33bf5c925446dde88c0c0f1ae4bc221f196f61241c3aa3fb4bb9ec4 Jul 22 15:13:26.708470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.708443 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb"] Jul 22 15:13:26.711008 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:26.710986 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks"] Jul 22 15:13:26.716310 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:26.716284 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91dbb804_e5c1_49af_b55e_af3209f15a44.slice/crio-c2c3f89016bc09b2c4ec72acc0ed5aa9783cc7a43eaaefb5c93b131274b7581a WatchSource:0}: Error finding container c2c3f89016bc09b2c4ec72acc0ed5aa9783cc7a43eaaefb5c93b131274b7581a: Status 404 returned error can't find the container with id c2c3f89016bc09b2c4ec72acc0ed5aa9783cc7a43eaaefb5c93b131274b7581a Jul 22 15:13:26.717166 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:26.717040 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a0f4fb_6387_4683_823f_b95a10427c76.slice/crio-b35d7f774a53ff26aa25fb479f5bf64a7a183f77a2d166f8ae1dc2f340164f96 WatchSource:0}: Error finding container b35d7f774a53ff26aa25fb479f5bf64a7a183f77a2d166f8ae1dc2f340164f96: Status 404 returned error can't find the container with id b35d7f774a53ff26aa25fb479f5bf64a7a183f77a2d166f8ae1dc2f340164f96 Jul 22 15:13:27.116301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.116217 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:27.118977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.118952 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 15:13:27.118977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.118960 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-97vtz\"" Jul 22 15:13:27.218762 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.218724 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.218831 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.218864 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.218886 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.218942 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:29.218922192 +0000 UTC m=+39.579004424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.219011 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.219024 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.219029 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.219080 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:29.219064448 +0000 UTC m=+39.579146677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:27.219265 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:27.219101 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:29.21909054 +0000 UTC m=+39.579172773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:27.373601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.373512 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cr7gm" event={"ID":"51160b4c-bb34-4a31-99ec-5230c597fc88","Type":"ContainerStarted","Data":"7e001a2dd33bf5c925446dde88c0c0f1ae4bc221f196f61241c3aa3fb4bb9ec4"} Jul 22 15:13:27.376471 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.376439 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" event={"ID":"45a0f4fb-6387-4683-823f-b95a10427c76","Type":"ContainerStarted","Data":"b35d7f774a53ff26aa25fb479f5bf64a7a183f77a2d166f8ae1dc2f340164f96"} Jul 22 15:13:27.378422 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.378353 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" event={"ID":"efe62586-cb4c-4815-8680-0fa68b9d311b","Type":"ContainerStarted","Data":"6c135294ed228f5afd3bf551977b63463df467bb4e174f206566e553f6f1d43a"} Jul 22 15:13:27.380096 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.380036 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" event={"ID":"91dbb804-e5c1-49af-b55e-af3209f15a44","Type":"ContainerStarted","Data":"c2c3f89016bc09b2c4ec72acc0ed5aa9783cc7a43eaaefb5c93b131274b7581a"} Jul 22 15:13:27.390709 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.390202 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="06652bc143cc3b44f361e7accf592bfe4ec0559424603f33af3d443ef9fa6810" exitCode=0 Jul 22 15:13:27.390709 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:27.390260 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"06652bc143cc3b44f361e7accf592bfe4ec0559424603f33af3d443ef9fa6810"} Jul 22 15:13:28.397908 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:28.397872 2542 generic.go:356] "Generic (PLEG): container finished" podID="7c21c649-f879-4bbb-90cd-f76c135fb773" containerID="e2fc9a667f70387e6354f91a2be616b57e58e4f4d8208f65d8ef66798694fe7d" exitCode=0 Jul 22 15:13:28.398335 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:28.397939 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerDied","Data":"e2fc9a667f70387e6354f91a2be616b57e58e4f4d8208f65d8ef66798694fe7d"} Jul 22 15:13:29.241573 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.241383 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:29.241755 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.241616 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:29.241755 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241540 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:29.241755 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.241688 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:29.241755 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241706 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:33.241688434 +0000 UTC m=+43.601770660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:29.241901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241787 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:29.241901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241801 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:29.241901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241819 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:29.241901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241855 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:33.241839812 +0000 UTC m=+43.601922056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:29.241901 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:29.241873 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:33.241864318 +0000 UTC m=+43.601946548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:29.405074 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.405037 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" event={"ID":"7c21c649-f879-4bbb-90cd-f76c135fb773","Type":"ContainerStarted","Data":"03b839e578f41152eeb99d9b775c6d72249d784c83f640521abbcec707a83829"} Jul 22 15:13:29.428357 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.428298 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sp6j4" podStartSLOduration=9.010422991 podStartE2EDuration="39.428277738s" totalImagesPullingTime="30.417854747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:29.427723513 +0000 UTC m=+39.787805758" watchObservedRunningTime="2026-07-22 15:13:29.428277738 +0000 UTC m=+39.788359989" Jul 22 15:13:29.567575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.567423 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:29.618075 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:29.617974 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:30.834921 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:30.834884 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:31.874179 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:31.874142 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:31.973218 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:31.973180 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:33.276976 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.276929 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.277040 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.277089 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277121 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277205 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:41.277182764 +0000 UTC m=+51.637265011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277224 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277224 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277236 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277287 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:41.27726965 +0000 UTC m=+51.637351882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:33.277385 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:33.277306 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:41.277296637 +0000 UTC m=+51.637378871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:33.418428 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.418386 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" event={"ID":"efe62586-cb4c-4815-8680-0fa68b9d311b","Type":"ContainerStarted","Data":"dd5c538028241b2e0b6306857b877c42c7a45f86757cc7694c400b899bd220b0"} Jul 22 15:13:33.420659 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.420604 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" event={"ID":"91dbb804-e5c1-49af-b55e-af3209f15a44","Type":"ContainerStarted","Data":"a1ab40bdebdb76e13255b29bb97099a8744a0455d7e55af9a677c3ede6a4f814"} Jul 22 15:13:33.422457 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.422423 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cr7gm" event={"ID":"51160b4c-bb34-4a31-99ec-5230c597fc88","Type":"ContainerStarted","Data":"c658cb609651d88774967c5cb5fa0c963f58bbe57e54d25b452910cf675e15c9"} Jul 22 15:13:33.424588 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.424565 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" event={"ID":"45a0f4fb-6387-4683-823f-b95a10427c76","Type":"ContainerStarted","Data":"d09460f21160afd8a77c618438cca8752e787274c99531490135aed5f6dacf69"} Jul 22 15:13:33.435231 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.435189 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" podStartSLOduration=34.643549641999996 podStartE2EDuration="40.435177151s" totalImagesPullingTime="5.791627509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:33.434859726 +0000 UTC m=+43.794941976" watchObservedRunningTime="2026-07-22 15:13:33.435177151 +0000 UTC m=+43.795259399" Jul 22 15:13:33.451973 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.451936 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" podStartSLOduration=32.681050102 podStartE2EDuration="38.451925134s" totalImagesPullingTime="5.770875032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:33.451291145 +0000 UTC m=+43.811373394" watchObservedRunningTime="2026-07-22 15:13:33.451925134 +0000 UTC m=+43.812007382" Jul 22 15:13:33.470123 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.470076 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rf5ks" podStartSLOduration=31.700835485 podStartE2EDuration="37.470059427s" totalImagesPullingTime="5.769223942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:33.468984775 +0000 UTC m=+43.829067026" watchObservedRunningTime="2026-07-22 15:13:33.470059427 +0000 UTC m=+43.830141677" Jul 22 15:13:33.484198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.484166 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cr7gm" podStartSLOduration=2.688410247 podStartE2EDuration="8.48415304s" totalImagesPullingTime="5.795742793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:33.484040429 +0000 UTC m=+43.844122682" watchObservedRunningTime="2026-07-22 15:13:33.48415304 +0000 UTC m=+43.844235290" Jul 22 15:13:33.556371 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.556287 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:33.656777 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.656747 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:33.758169 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:33.758137 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:34.097782 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:34.097741 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:34.169831 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:34.169796 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:34.255630 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:34.255594 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:34.345833 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:34.345801 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:34.445975 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:34.445892 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:35.236480 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:35.236448 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:35.330644 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:35.330614 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:35.431776 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:35.431743 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:35.632894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:35.632864 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:35.697811 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:35.697778 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:36.249427 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:36.249392 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:36.319920 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:36.319882 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:36.505960 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:36.505871 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:36.974112 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:36.974085 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.429013 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.428976 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.528659 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.528610 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.633978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.633947 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.731529 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.731436 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.829675 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.829622 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:39.940815 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:39.940783 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:40.192686 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:40.192654 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:40.332331 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:40.332304 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:40.435266 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:40.435234 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:41.339861 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.339825 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.339871 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.339919 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.339966 2542 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.339989 2542 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75bdb5864b-7mhm2: secret "image-registry-tls" not found Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.340007 2542 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 15:13:41.340048 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.340042 2542 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 15:13:41.340253 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.340047 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls podName:b3312c9a-4418-4b63-9e00-61f1bed394e7 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:57.340028681 +0000 UTC m=+67.700110914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls") pod "image-registry-75bdb5864b-7mhm2" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7") : secret "image-registry-tls" not found Jul 22 15:13:41.340253 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.340116 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls podName:10a7f95b-e941-4f24-a9a3-5ad298f3252d nodeName:}" failed. No retries permitted until 2026-07-22 15:13:57.340095979 +0000 UTC m=+67.700178210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls") pod "dns-default-zfmzk" (UID: "10a7f95b-e941-4f24-a9a3-5ad298f3252d") : secret "dns-default-metrics-tls" not found Jul 22 15:13:41.340253 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:13:41.340137 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert podName:b936e7fd-7ba5-4e3b-a8fa-abfd4992e532 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:57.340127738 +0000 UTC m=+67.700209972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-679vz" (UID: "b936e7fd-7ba5-4e3b-a8fa-abfd4992e532") : secret "networking-console-plugin-cert" not found Jul 22 15:13:41.357192 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.357161 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:41.584565 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.584537 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:41.782429 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.782337 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:41.988209 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:41.988168 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:42.589605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:42.589574 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:42.991320 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:42.991233 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:43.189207 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:43.189162 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:43.300702 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:43.300599 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:43.400843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:43.400813 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:43.798884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:43.798841 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:44.181686 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:44.181656 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:44.316555 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:44.316522 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:44.417002 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:44.416973 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:44.789871 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:44.789835 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:45.625565 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:45.625525 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:45.726521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:45.726491 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:45.828837 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:45.828813 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:46.348939 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:46.348914 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:46.451404 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:46.451374 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:46.797163 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:46.797091 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:47.389453 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:47.389416 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:47.791460 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:47.791369 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:48.000998 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:48.000969 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:48.479807 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:48.479770 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:48.583573 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:48.583543 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:49.001684 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:49.001657 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:49.394726 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:49.394693 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:49.585130 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:49.585102 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:49.805660 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:49.805577 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:50.359606 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:50.359577 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xws6g" Jul 22 15:13:52.870556 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:52.870516 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:52.971279 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:52.971246 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:55.852808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.852759 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:55.852808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.852823 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:55.855557 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.855538 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 15:13:55.856082 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.856066 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 15:13:55.867882 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.867844 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da458b9c-57c9-4d92-b354-b5fa06579eee-metrics-certs\") pod \"network-metrics-daemon-lpgzv\" (UID: \"da458b9c-57c9-4d92-b354-b5fa06579eee\") " pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:55.868011 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.867900 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/034c6996-5ef8-4346-b9d1-57d3f994ed05-original-pull-secret\") pod \"global-pull-secret-syncer-vh5lj\" (UID: \"034c6996-5ef8-4346-b9d1-57d3f994ed05\") " pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:55.927840 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.927809 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-97vtz\"" Jul 22 15:13:55.935944 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.935922 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpgzv" Jul 22 15:13:55.953339 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.953312 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:55.955977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:55.955951 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvhs\" (UniqueName: \"kubernetes.io/projected/ab50bc25-28dd-44d6-86b8-d6182c65bb49-kube-api-access-gpvhs\") pod \"network-check-target-gs9v6\" (UID: \"ab50bc25-28dd-44d6-86b8-d6182c65bb49\") " pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:56.064675 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.064614 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpgzv"] Jul 22 15:13:56.067523 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.067493 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda458b9c_57c9_4d92_b354_b5fa06579eee.slice/crio-6d6c299e2d6953f6838784f307d69226f6a68777f20f195f260564e556056d59 WatchSource:0}: Error finding container 6d6c299e2d6953f6838784f307d69226f6a68777f20f195f260564e556056d59: Status 404 returned error can't find the container with id 6d6c299e2d6953f6838784f307d69226f6a68777f20f195f260564e556056d59 Jul 22 15:13:56.127857 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.127772 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vh5lj" Jul 22 15:13:56.136458 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.136425 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glqml\"" Jul 22 15:13:56.144308 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.144273 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:56.272291 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.272260 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vh5lj"] Jul 22 15:13:56.275243 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.275220 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034c6996_5ef8_4346_b9d1_57d3f994ed05.slice/crio-6144f7d1ebf6f06668603919e40ec6f65ddfd9097ea2d27e5766ced9f3887ef8 WatchSource:0}: Error finding container 6144f7d1ebf6f06668603919e40ec6f65ddfd9097ea2d27e5766ced9f3887ef8: Status 404 returned error can't find the container with id 6144f7d1ebf6f06668603919e40ec6f65ddfd9097ea2d27e5766ced9f3887ef8 Jul 22 15:13:56.311473 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.311436 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gs9v6"] Jul 22 15:13:56.317490 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.317455 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab50bc25_28dd_44d6_86b8_d6182c65bb49.slice/crio-1a19574dd9d8908cb7cef85777614d2ce3a8173600a37bf59b76c247413dd4eb WatchSource:0}: Error finding container 1a19574dd9d8908cb7cef85777614d2ce3a8173600a37bf59b76c247413dd4eb: Status 404 returned error can't find the container with id 1a19574dd9d8908cb7cef85777614d2ce3a8173600a37bf59b76c247413dd4eb Jul 22 15:13:56.337410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.337384 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8szf4"] Jul 22 15:13:56.339186 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.339171 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.341935 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.341916 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 15:13:56.342460 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.342442 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 15:13:56.342526 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.342472 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 15:13:56.342526 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.342515 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 15:13:56.344496 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.344482 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jb8mz\"" Jul 22 15:13:56.349587 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.349565 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 15:13:56.363571 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.360921 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8szf4"] Jul 22 15:13:56.365256 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.365233 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp"] Jul 22 15:13:56.367254 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.367232 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.369985 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.369967 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 15:13:56.370347 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.370319 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jt65v\"" Jul 22 15:13:56.370534 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.370518 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 15:13:56.370621 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.370577 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 15:13:56.370621 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.370600 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 22 15:13:56.384047 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.384017 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp"] Jul 22 15:13:56.401696 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.401669 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk"] Jul 22 15:13:56.403888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.403866 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.406401 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.406369 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6668855dd4-lktdf"] Jul 22 15:13:56.406576 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.406558 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-668h8\"" Jul 22 15:13:56.406717 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.406698 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 15:13:56.406778 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.406733 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 15:13:56.407893 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.407873 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 15:13:56.408367 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.408353 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.410370 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.410353 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 15:13:56.410662 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.410629 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 15:13:56.411962 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.411942 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 15:13:56.412114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.412098 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tpkl9\"" Jul 22 15:13:56.412164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.412124 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 15:13:56.412255 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.412207 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 15:13:56.412477 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.412462 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 15:13:56.412477 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.412473 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 15:13:56.424503 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.424475 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk"] Jul 22 15:13:56.427877 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.427854 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6668855dd4-lktdf"] Jul 22 15:13:56.457104 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457074 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8xz8\" (UniqueName: \"kubernetes.io/projected/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-kube-api-access-d8xz8\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.457104 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457111 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457135 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd26m\" (UniqueName: \"kubernetes.io/projected/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-kube-api-access-pd26m\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457186 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-tmp\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457219 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f599a54-27e8-40c0-aff0-5062ad057373-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457246 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-default-certificate\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457266 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-service-ca-bundle\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.457332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457291 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-service-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.457506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457341 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-snapshots\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.457506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457377 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6f599a54-27e8-40c0-aff0-5062ad057373-kube-api-access-2qnwr\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.457506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457424 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-stats-auth\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.457506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457461 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-644bl\" (UniqueName: \"kubernetes.io/projected/f46f5997-06b5-4668-9acb-49d024dc3a12-kube-api-access-644bl\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.457506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457505 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f46f5997-06b5-4668-9acb-49d024dc3a12-serving-cert\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.457662 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457527 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-metrics-certs\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.457662 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457565 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.457662 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.457595 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.467836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.467804 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:56.481859 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.481830 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gs9v6" event={"ID":"ab50bc25-28dd-44d6-86b8-d6182c65bb49","Type":"ContainerStarted","Data":"a3b8ddd6e11475cbb2c3cfd27d043a94ad9517f39a2b30f0b587bda2c62ee281"} Jul 22 15:13:56.482039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.481878 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gs9v6" event={"ID":"ab50bc25-28dd-44d6-86b8-d6182c65bb49","Type":"ContainerStarted","Data":"1a19574dd9d8908cb7cef85777614d2ce3a8173600a37bf59b76c247413dd4eb"} Jul 22 15:13:56.482039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.481897 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:13:56.483147 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.483122 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vh5lj" event={"ID":"034c6996-5ef8-4346-b9d1-57d3f994ed05","Type":"ContainerStarted","Data":"6144f7d1ebf6f06668603919e40ec6f65ddfd9097ea2d27e5766ced9f3887ef8"} Jul 22 15:13:56.484211 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.484190 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpgzv" event={"ID":"da458b9c-57c9-4d92-b354-b5fa06579eee","Type":"ContainerStarted","Data":"6d6c299e2d6953f6838784f307d69226f6a68777f20f195f260564e556056d59"} Jul 22 15:13:56.496934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.496900 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j"] Jul 22 15:13:56.498996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.498980 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.501867 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.501848 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 15:13:56.502515 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.502489 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n858g\"" Jul 22 15:13:56.502627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.502500 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:13:56.502725 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.502674 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 15:13:56.525443 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.525407 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j"] Jul 22 15:13:56.525589 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.525519 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gs9v6" podStartSLOduration=66.525504903 podStartE2EDuration="1m6.525504903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:56.520760408 +0000 UTC m=+66.880842657" watchObservedRunningTime="2026-07-22 15:13:56.525504903 +0000 UTC m=+66.885587129" Jul 22 15:13:56.558398 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558368 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8xz8\" (UniqueName: \"kubernetes.io/projected/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-kube-api-access-d8xz8\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558409 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2fcv\" (UniqueName: \"kubernetes.io/projected/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-kube-api-access-z2fcv\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558427 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558443 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd26m\" (UniqueName: \"kubernetes.io/projected/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-kube-api-access-pd26m\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558459 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-tmp\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558487 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f599a54-27e8-40c0-aff0-5062ad057373-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558530 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-default-certificate\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.558575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558561 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-service-ca-bundle\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.559032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558604 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-service-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.559032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558854 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-snapshots\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.559032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558899 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6f599a54-27e8-40c0-aff0-5062ad057373-kube-api-access-2qnwr\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.559032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558937 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-stats-auth\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.559032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.558973 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-644bl\" (UniqueName: \"kubernetes.io/projected/f46f5997-06b5-4668-9acb-49d024dc3a12-kube-api-access-644bl\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.559281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559053 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.559281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559088 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f46f5997-06b5-4668-9acb-49d024dc3a12-serving-cert\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.559281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559124 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-metrics-certs\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.559281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559151 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.559281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559181 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.559890 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559372 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-service-ca-bundle\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.560983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.559986 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-snapshots\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.560983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.560436 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f5997-06b5-4668-9acb-49d024dc3a12-tmp\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.560983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.560916 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.560983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.560916 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-service-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.561969 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.561930 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.562073 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.562010 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-default-certificate\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.562207 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.562187 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f5997-06b5-4668-9acb-49d024dc3a12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.562260 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.562222 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-metrics-certs\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.562294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.562259 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f599a54-27e8-40c0-aff0-5062ad057373-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.562711 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.562694 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-stats-auth\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.563569 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.563552 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f46f5997-06b5-4668-9acb-49d024dc3a12-serving-cert\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.583587 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.583555 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-644bl\" (UniqueName: \"kubernetes.io/projected/f46f5997-06b5-4668-9acb-49d024dc3a12-kube-api-access-644bl\") pod \"insights-operator-555d9d7885-8szf4\" (UID: \"f46f5997-06b5-4668-9acb-49d024dc3a12\") " pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.584237 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.584216 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8xz8\" (UniqueName: \"kubernetes.io/projected/772076b4-2a6b-460e-ad04-f7fa0cf2be3c-kube-api-access-d8xz8\") pod \"cluster-monitoring-operator-76cf8966f8-q77xk\" (UID: \"772076b4-2a6b-460e-ad04-f7fa0cf2be3c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.584492 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.584470 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd26m\" (UniqueName: \"kubernetes.io/projected/addc21c7-0b9c-4dfb-a58f-f5a25e1bb188-kube-api-access-pd26m\") pod \"router-default-6668855dd4-lktdf\" (UID: \"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188\") " pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.585697 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.585672 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6f599a54-27e8-40c0-aff0-5062ad057373-kube-api-access-2qnwr\") pod \"managed-serviceaccount-addon-agent-7696759bb8-xzxlp\" (UID: \"6f599a54-27e8-40c0-aff0-5062ad057373\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.617309 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.617279 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:56.660436 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.660350 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-8szf4" Jul 22 15:13:56.660568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.660493 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2fcv\" (UniqueName: \"kubernetes.io/projected/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-kube-api-access-z2fcv\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.660568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.660554 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.663340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.663294 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.670466 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.670439 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2fcv\" (UniqueName: \"kubernetes.io/projected/e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0-kube-api-access-z2fcv\") pod \"cluster-samples-operator-79b7c55f87-qbz9j\" (UID: \"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.686439 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.686408 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" Jul 22 15:13:56.707251 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.707175 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:56.714790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.714505 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" Jul 22 15:13:56.720738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.720502 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:56.808720 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.808435 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" Jul 22 15:13:56.833792 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.833699 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-8szf4"] Jul 22 15:13:56.839953 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.839901 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f5997_06b5_4668_9acb_49d024dc3a12.slice/crio-fe1f9007c44bfcc826c5614d17728871342dbd07cd0fe70875674acc733544e7 WatchSource:0}: Error finding container fe1f9007c44bfcc826c5614d17728871342dbd07cd0fe70875674acc733544e7: Status 404 returned error can't find the container with id fe1f9007c44bfcc826c5614d17728871342dbd07cd0fe70875674acc733544e7 Jul 22 15:13:56.874515 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.874440 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp"] Jul 22 15:13:56.895872 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.895788 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f599a54_27e8_40c0_aff0_5062ad057373.slice/crio-dd5b5637d10ab62f28ffb1b9534bc93e6469a23b55adb46b05a20d9097280923 WatchSource:0}: Error finding container dd5b5637d10ab62f28ffb1b9534bc93e6469a23b55adb46b05a20d9097280923: Status 404 returned error can't find the container with id dd5b5637d10ab62f28ffb1b9534bc93e6469a23b55adb46b05a20d9097280923 Jul 22 15:13:56.902386 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.902356 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:56.916936 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.916700 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk"] Jul 22 15:13:56.919310 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.919281 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772076b4_2a6b_460e_ad04_f7fa0cf2be3c.slice/crio-944a6a8b07185067a40f00b3927966a60e60fb8b8414c989df440d488bf0842b WatchSource:0}: Error finding container 944a6a8b07185067a40f00b3927966a60e60fb8b8414c989df440d488bf0842b: Status 404 returned error can't find the container with id 944a6a8b07185067a40f00b3927966a60e60fb8b8414c989df440d488bf0842b Jul 22 15:13:56.935073 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.935043 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6668855dd4-lktdf"] Jul 22 15:13:56.937621 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:56.937593 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddc21c7_0b9c_4dfb_a58f_f5a25e1bb188.slice/crio-670f1ce86fbb97f716ef1121910a41cf296b368363cf3f4349a9e75680fa39ed WatchSource:0}: Error finding container 670f1ce86fbb97f716ef1121910a41cf296b368363cf3f4349a9e75680fa39ed: Status 404 returned error can't find the container with id 670f1ce86fbb97f716ef1121910a41cf296b368363cf3f4349a9e75680fa39ed Jul 22 15:13:56.996614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.996577 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j"] Jul 22 15:13:56.998950 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:56.998916 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:57.370031 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.369979 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:57.370225 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.370052 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:57.370225 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.370109 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:57.373050 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.373020 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10a7f95b-e941-4f24-a9a3-5ad298f3252d-metrics-tls\") pod \"dns-default-zfmzk\" (UID: \"10a7f95b-e941-4f24-a9a3-5ad298f3252d\") " pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:57.373537 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.373512 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"image-registry-75bdb5864b-7mhm2\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:57.373677 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.373513 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b936e7fd-7ba5-4e3b-a8fa-abfd4992e532-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-679vz\" (UID: \"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:57.490090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.489991 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6668855dd4-lktdf" event={"ID":"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188","Type":"ContainerStarted","Data":"ffbb2bf58bd6667140c33ea02cb72effef2b91146c93c61cb37922ed011363ed"} Jul 22 15:13:57.490090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.490055 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6668855dd4-lktdf" event={"ID":"addc21c7-0b9c-4dfb-a58f-f5a25e1bb188","Type":"ContainerStarted","Data":"670f1ce86fbb97f716ef1121910a41cf296b368363cf3f4349a9e75680fa39ed"} Jul 22 15:13:57.491533 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.491508 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8szf4" event={"ID":"f46f5997-06b5-4668-9acb-49d024dc3a12","Type":"ContainerStarted","Data":"fe1f9007c44bfcc826c5614d17728871342dbd07cd0fe70875674acc733544e7"} Jul 22 15:13:57.492771 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.492745 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" event={"ID":"772076b4-2a6b-460e-ad04-f7fa0cf2be3c","Type":"ContainerStarted","Data":"944a6a8b07185067a40f00b3927966a60e60fb8b8414c989df440d488bf0842b"} Jul 22 15:13:57.494036 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.494015 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" event={"ID":"6f599a54-27e8-40c0-aff0-5062ad057373","Type":"ContainerStarted","Data":"dd5b5637d10ab62f28ffb1b9534bc93e6469a23b55adb46b05a20d9097280923"} Jul 22 15:13:57.495240 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.495218 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" event={"ID":"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0","Type":"ContainerStarted","Data":"b0368c35caacf3f5a65d9810e76c01a114f4135fc533d40816a1cdf9d09e8438"} Jul 22 15:13:57.508906 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.508847 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6668855dd4-lktdf" podStartSLOduration=1.508824668 podStartE2EDuration="1.508824668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:57.508127478 +0000 UTC m=+67.868209735" watchObservedRunningTime="2026-07-22 15:13:57.508824668 +0000 UTC m=+67.868906920" Jul 22 15:13:57.636446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.636410 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tf8ct\"" Jul 22 15:13:57.644669 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.644410 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" Jul 22 15:13:57.654347 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.654301 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjvqb\"" Jul 22 15:13:57.662908 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.662793 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:57.668175 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.668058 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j8ghg\"" Jul 22 15:13:57.676307 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.676152 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zfmzk" Jul 22 15:13:57.721810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.721705 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:57.725435 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.725215 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:57.862563 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.862494 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-679vz"] Jul 22 15:13:57.877134 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:13:57.877050 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb936e7fd_7ba5_4e3b_a8fa_abfd4992e532.slice/crio-b2206c383988f99ac4d641aee2308dfea9bb00538fb3247e83d1b86e88a2fc22 WatchSource:0}: Error finding container b2206c383988f99ac4d641aee2308dfea9bb00538fb3247e83d1b86e88a2fc22: Status 404 returned error can't find the container with id b2206c383988f99ac4d641aee2308dfea9bb00538fb3247e83d1b86e88a2fc22 Jul 22 15:13:57.970922 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:57.970793 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zfmzk"] Jul 22 15:13:58.140960 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.140873 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:13:58.506258 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.506110 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfmzk" event={"ID":"10a7f95b-e941-4f24-a9a3-5ad298f3252d","Type":"ContainerStarted","Data":"dfd2c8b1cad7ee7d9aab22426f3b1871609a8f0ec330c497d3dee02a7584e4a6"} Jul 22 15:13:58.510315 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.510230 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" event={"ID":"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532","Type":"ContainerStarted","Data":"b2206c383988f99ac4d641aee2308dfea9bb00538fb3247e83d1b86e88a2fc22"} Jul 22 15:13:58.513886 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.513855 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" event={"ID":"b3312c9a-4418-4b63-9e00-61f1bed394e7","Type":"ContainerStarted","Data":"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493"} Jul 22 15:13:58.514031 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.513910 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" event={"ID":"b3312c9a-4418-4b63-9e00-61f1bed394e7","Type":"ContainerStarted","Data":"6aee451eaaa0a262a0714c79cc20fc7d822d93c6cce6e6fa2ef53878005154e8"} Jul 22 15:13:58.514733 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.514713 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:13:58.527150 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.527106 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpgzv" event={"ID":"da458b9c-57c9-4d92-b354-b5fa06579eee","Type":"ContainerStarted","Data":"3422876b23e67885ff03e4cea04c787db83a5da37cce85737418ed0999ef29a3"} Jul 22 15:13:58.527333 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.527171 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpgzv" event={"ID":"da458b9c-57c9-4d92-b354-b5fa06579eee","Type":"ContainerStarted","Data":"fee938abdbc7bb08a47a2d635ecde1cd646dc10f579bcaf127d077bf623fd200"} Jul 22 15:13:58.527333 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.527210 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:58.528651 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.528549 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6668855dd4-lktdf" Jul 22 15:13:58.560151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.559482 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" podStartSLOduration=45.55945902 podStartE2EDuration="45.55945902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:58.538353081 +0000 UTC m=+68.898435330" watchObservedRunningTime="2026-07-22 15:13:58.55945902 +0000 UTC m=+68.919541270" Jul 22 15:13:58.696492 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.696424 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:58.776486 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:58.776336 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:59.212313 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:59.212178 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:13:59.310802 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:13:59.310746 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.170314 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.170277 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.266685 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.266631 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.367908 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.367877 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.436704 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.436602 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.537539 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.537503 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.817994 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.817899 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:01.923416 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:01.923381 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:03.301934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:03.301892 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:03.401481 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:03.401443 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:03.461505 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:03.461455 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:03.582570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:03.582060 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:04.012334 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:04.012242 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:04.361045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:04.360994 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:04.463079 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:04.463043 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:04.974762 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:04.974725 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:05.231168 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:05.231079 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:05.330995 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:05.330957 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:05.430758 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:05.430712 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:05.602265 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:05.602217 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.004282 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.004240 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.105097 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.105061 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.202419 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.202381 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.503035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.502937 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.529876 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.529815 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lpgzv" podStartSLOduration=75.05147761 podStartE2EDuration="1m16.529791222s" totalImagesPullingTime="1.478313612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:58.575484674 +0000 UTC m=+68.935566924" watchObservedRunningTime="2026-07-22 15:14:06.529791222 +0000 UTC m=+76.889873452" Jul 22 15:14:06.534226 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.534189 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2rsf2"] Jul 22 15:14:06.538009 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.537976 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.541689 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.541664 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 15:14:06.541821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.541726 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rppjt\"" Jul 22 15:14:06.541931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.541901 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 15:14:06.544533 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.544507 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rsf2"] Jul 22 15:14:06.563977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.563943 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" event={"ID":"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0","Type":"ContainerStarted","Data":"1253d1d9fbb4a544acc01043bb564aa76ac71886f01826b4419c4bb547f9d786"} Jul 22 15:14:06.564234 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.563997 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" event={"ID":"e300c10c-e40d-4ea6-b44b-9b48c9ef5ac0","Type":"ContainerStarted","Data":"c0baaab2cc91857c831af1f0edc6037fbb7120b50d28c69225a290bd39df26ce"} Jul 22 15:14:06.565558 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.565533 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-8szf4" event={"ID":"f46f5997-06b5-4668-9acb-49d024dc3a12","Type":"ContainerStarted","Data":"d88801533faf5fd2934fa5bc770709543c2eb7502fed20f81ec211c5e25963a0"} Jul 22 15:14:06.567317 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.567291 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vh5lj" event={"ID":"034c6996-5ef8-4346-b9d1-57d3f994ed05","Type":"ContainerStarted","Data":"6409038dcf661089c54da5d663867e7efe6ff01832ac793b81067f2f21053d34"} Jul 22 15:14:06.569126 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.569099 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" event={"ID":"772076b4-2a6b-460e-ad04-f7fa0cf2be3c","Type":"ContainerStarted","Data":"76bda615d93181ab415e356a34e4152eb66ecfc0a2509552d42205286239e080"} Jul 22 15:14:06.570966 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.570946 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfmzk" event={"ID":"10a7f95b-e941-4f24-a9a3-5ad298f3252d","Type":"ContainerStarted","Data":"c75b04752fe09ec3d602b371f2f1d93698daf3d5739b1f2194ca0a7be818a4ee"} Jul 22 15:14:06.571065 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.570988 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfmzk" event={"ID":"10a7f95b-e941-4f24-a9a3-5ad298f3252d","Type":"ContainerStarted","Data":"01c9da0e31bf5f974e9aa36465388b4e45f28fed3db54ca7482a259e4a4d401e"} Jul 22 15:14:06.571119 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.571063 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zfmzk" Jul 22 15:14:06.573210 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.573185 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" event={"ID":"6f599a54-27e8-40c0-aff0-5062ad057373","Type":"ContainerStarted","Data":"69db2b671150a6d6713d07fc28533c4c7dc49d5107851aca396347cf9ed7eac9"} Jul 22 15:14:06.574907 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.574887 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" event={"ID":"b936e7fd-7ba5-4e3b-a8fa-abfd4992e532","Type":"ContainerStarted","Data":"f7739a8575123b91c6c6e1076a138f0f17c08f349fcffab6a84082681efd8090"} Jul 22 15:14:06.584605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.584555 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qbz9j" podStartSLOduration=2.025736841 podStartE2EDuration="10.584540664s" totalImagesPullingTime="8.558803823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.584241136 +0000 UTC m=+76.944323388" watchObservedRunningTime="2026-07-22 15:14:06.584540664 +0000 UTC m=+76.944622975" Jul 22 15:14:06.586448 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.586422 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.605628 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.605579 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-679vz" podStartSLOduration=35.92374419 podStartE2EDuration="43.605564206s" totalImagesPullingTime="7.681820016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.604995861 +0000 UTC m=+76.965078112" watchObservedRunningTime="2026-07-22 15:14:06.605564206 +0000 UTC m=+76.965646455" Jul 22 15:14:06.624396 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.624347 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zfmzk" podStartSLOduration=34.015193675 podStartE2EDuration="41.624327924s" totalImagesPullingTime="7.609134249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.622787922 +0000 UTC m=+76.982870173" watchObservedRunningTime="2026-07-22 15:14:06.624327924 +0000 UTC m=+76.984410175" Jul 22 15:14:06.641010 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.640952 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-8szf4" podStartSLOduration=1.893967271 podStartE2EDuration="10.640934495s" totalImagesPullingTime="8.746967224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.638798486 +0000 UTC m=+76.998880743" watchObservedRunningTime="2026-07-22 15:14:06.640934495 +0000 UTC m=+77.001016744" Jul 22 15:14:06.653894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.653792 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.653894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.653859 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.654243 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.654221 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zpx8\" (UniqueName: \"kubernetes.io/projected/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-api-access-4zpx8\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.654488 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.654469 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e29b336-91e6-4afd-b54c-a1bc16a86e89-crio-socket\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.654606 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.654590 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e29b336-91e6-4afd-b54c-a1bc16a86e89-data-volume\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.655091 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.654459 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vh5lj" podStartSLOduration=66.317332496 podStartE2EDuration="1m15.654443192s" totalImagesPullingTime="9.337110696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.653388485 +0000 UTC m=+77.013470734" watchObservedRunningTime="2026-07-22 15:14:06.654443192 +0000 UTC m=+77.014525449" Jul 22 15:14:06.669012 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.668971 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7696759bb8-xzxlp" podStartSLOduration=1.977960415 podStartE2EDuration="10.668958519s" totalImagesPullingTime="8.690998104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.668807723 +0000 UTC m=+77.028889972" watchObservedRunningTime="2026-07-22 15:14:06.668958519 +0000 UTC m=+77.029040767" Jul 22 15:14:06.687714 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.687675 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-q77xk" podStartSLOduration=2.021239797 podStartE2EDuration="10.687660595s" totalImagesPullingTime="8.666420798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:06.686276909 +0000 UTC m=+77.046359158" watchObservedRunningTime="2026-07-22 15:14:06.687660595 +0000 UTC m=+77.047742843" Jul 22 15:14:06.739991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.739952 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:06.755833 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755740 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e29b336-91e6-4afd-b54c-a1bc16a86e89-crio-socket\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.755833 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755784 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e29b336-91e6-4afd-b54c-a1bc16a86e89-data-volume\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756055 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755867 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e29b336-91e6-4afd-b54c-a1bc16a86e89-crio-socket\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756055 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755911 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756055 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755945 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756055 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.755983 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zpx8\" (UniqueName: \"kubernetes.io/projected/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-api-access-4zpx8\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756246 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:06.756060 2542 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 15:14:06.756246 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:06.756088 2542 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 15:14:06.756246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.756090 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e29b336-91e6-4afd-b54c-a1bc16a86e89-data-volume\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.756246 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:06.756138 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:07.256119615 +0000 UTC m=+77.616201857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : configmap "kube-rbac-proxy" not found Jul 22 15:14:06.756246 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:06.756163 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:07.256147366 +0000 UTC m=+77.616229599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : secret "insights-runtime-extractor-tls" not found Jul 22 15:14:06.764947 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.764921 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zpx8\" (UniqueName: \"kubernetes.io/projected/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-api-access-4zpx8\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:06.839028 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:06.838991 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:07.260745 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:07.260702 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:07.260745 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:07.260752 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:07.260966 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:07.260873 2542 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 15:14:07.260966 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:07.260884 2542 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 15:14:07.260966 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:07.260948 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:08.260929197 +0000 UTC m=+78.621011438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : configmap "kube-rbac-proxy" not found Jul 22 15:14:07.260966 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:07.260963 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:08.260957229 +0000 UTC m=+78.621039456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : secret "insights-runtime-extractor-tls" not found Jul 22 15:14:07.410893 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:07.410856 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:07.471196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:07.471164 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:07.924859 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:07.924825 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfmzk_10a7f95b-e941-4f24-a9a3-5ad298f3252d/dns/0.log" Jul 22 15:14:08.124141 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:08.124115 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfmzk_10a7f95b-e941-4f24-a9a3-5ad298f3252d/kube-rbac-proxy/0.log" Jul 22 15:14:08.269766 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:08.269661 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:08.269766 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:08.269719 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:08.269980 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:08.269790 2542 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 15:14:08.269980 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:08.269820 2542 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 15:14:08.269980 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:08.269844 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:10.269831039 +0000 UTC m=+80.629913279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : configmap "kube-rbac-proxy" not found Jul 22 15:14:08.269980 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:08.269885 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:10.269872674 +0000 UTC m=+80.629954901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : secret "insights-runtime-extractor-tls" not found Jul 22 15:14:08.724060 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:08.724029 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n5lnc_3a7cb4f1-f769-49d9-bf11-bf06d3457ba7/dns-node-resolver/0.log" Jul 22 15:14:09.088243 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.088206 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:09.124117 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.124080 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75bdb5864b-7mhm2_b3312c9a-4418-4b63-9e00-61f1bed394e7/registry/0.log" Jul 22 15:14:09.145721 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.145682 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:09.523917 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.523844 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fch8d_2f9cebe6-2201-4395-9989-8bf8a15fddcd/node-ca/0.log" Jul 22 15:14:09.791461 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.791372 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:09.846123 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.846087 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:09.925138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:09.925107 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6668855dd4-lktdf_addc21c7-0b9c-4dfb-a58f-f5a25e1bb188/router/0.log" Jul 22 15:14:10.124112 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.124081 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cr7gm_51160b4c-bb34-4a31-99ec-5230c597fc88/serve-healthcheck-canary/0.log" Jul 22 15:14:10.246958 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.246916 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:10.287040 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.286999 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:10.287217 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.287053 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:10.287217 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:10.287153 2542 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 15:14:10.287217 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:10.287156 2542 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 15:14:10.287310 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:10.287222 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:14.287207751 +0000 UTC m=+84.647289978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : configmap "kube-rbac-proxy" not found Jul 22 15:14:10.287310 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:10.287252 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls podName:2e29b336-91e6-4afd-b54c-a1bc16a86e89 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:14.287232077 +0000 UTC m=+84.647314307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2rsf2" (UID: "2e29b336-91e6-4afd-b54c-a1bc16a86e89") : secret "insights-runtime-extractor-tls" not found Jul 22 15:14:10.380219 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.380135 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:10.461857 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:10.461826 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:11.997530 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:11.997414 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.301562 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.301481 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.401557 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.401518 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.505566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.505526 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.635753 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.635711 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.735446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.735410 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:12.921012 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:12.920928 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:14.319329 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.319300 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:14.319737 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.319392 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:14.319940 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.319917 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e29b336-91e6-4afd-b54c-a1bc16a86e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:14.321856 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.321835 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e29b336-91e6-4afd-b54c-a1bc16a86e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rsf2\" (UID: \"2e29b336-91e6-4afd-b54c-a1bc16a86e89\") " pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:14.350821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.350794 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rsf2" Jul 22 15:14:14.480966 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.480925 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rsf2"] Jul 22 15:14:14.485831 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:14:14.485785 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e29b336_91e6_4afd_b54c_a1bc16a86e89.slice/crio-2cb6fffe2f38cab7a52679ac4f65cdd484bcb3d0fe529301dac29463d84b6405 WatchSource:0}: Error finding container 2cb6fffe2f38cab7a52679ac4f65cdd484bcb3d0fe529301dac29463d84b6405: Status 404 returned error can't find the container with id 2cb6fffe2f38cab7a52679ac4f65cdd484bcb3d0fe529301dac29463d84b6405 Jul 22 15:14:14.603127 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:14.603074 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rsf2" event={"ID":"2e29b336-91e6-4afd-b54c-a1bc16a86e89","Type":"ContainerStarted","Data":"2cb6fffe2f38cab7a52679ac4f65cdd484bcb3d0fe529301dac29463d84b6405"} Jul 22 15:14:15.525275 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.525239 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:15.625393 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.625347 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:15.748198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.748162 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p5pjm"] Jul 22 15:14:15.750744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.750721 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.751390 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.750890 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:15.753506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.753483 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 15:14:15.754260 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.754086 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 15:14:15.754534 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.754515 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m4x9h\"" Jul 22 15:14:15.754607 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.754515 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 15:14:15.754888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.754863 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 15:14:15.830454 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830362 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-wtmp\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830454 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830414 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-root\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830454 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830445 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-sys\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830511 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-metrics-client-ca\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830595 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830624 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830702 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffwv\" (UniqueName: \"kubernetes.io/projected/aeebc12b-214b-4bb5-a264-73999ba52933-kube-api-access-6ffwv\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830746 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-textfile\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.830878 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.830810 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-tls\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.931859 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.931821 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffwv\" (UniqueName: \"kubernetes.io/projected/aeebc12b-214b-4bb5-a264-73999ba52933-kube-api-access-6ffwv\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932010 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.931895 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-textfile\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932010 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.931918 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-tls\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932010 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.931957 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-wtmp\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932010 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.931993 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-root\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932253 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932021 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-sys\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932253 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932044 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-metrics-client-ca\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932253 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932086 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932253 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932128 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.932881 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932857 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-textfile\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.933043 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.932912 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.933290 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.933270 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-root\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.933376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.933306 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-sys\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.933436 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.933396 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-wtmp\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.933727 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.933705 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeebc12b-214b-4bb5-a264-73999ba52933-metrics-client-ca\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.935951 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.935925 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-tls\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.936426 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.936404 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeebc12b-214b-4bb5-a264-73999ba52933-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.942369 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.942348 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffwv\" (UniqueName: \"kubernetes.io/projected/aeebc12b-214b-4bb5-a264-73999ba52933-kube-api-access-6ffwv\") pod \"node-exporter-p5pjm\" (UID: \"aeebc12b-214b-4bb5-a264-73999ba52933\") " pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:15.948798 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:15.948771 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.048377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.048339 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.062174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.062147 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5pjm" Jul 22 15:14:16.074574 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:14:16.074544 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeebc12b_214b_4bb5_a264_73999ba52933.slice/crio-d84d6fcbfde3a01640dfdb2edb2d1dc0276f3953389b18fa3ed38c43184120d0 WatchSource:0}: Error finding container d84d6fcbfde3a01640dfdb2edb2d1dc0276f3953389b18fa3ed38c43184120d0: Status 404 returned error can't find the container with id d84d6fcbfde3a01640dfdb2edb2d1dc0276f3953389b18fa3ed38c43184120d0 Jul 22 15:14:16.212664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.212600 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.314447 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.314407 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.487056 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.486965 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.581249 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.581220 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zfmzk" Jul 22 15:14:16.585421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.585393 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.612367 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.612282 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5pjm" event={"ID":"aeebc12b-214b-4bb5-a264-73999ba52933","Type":"ContainerStarted","Data":"d84d6fcbfde3a01640dfdb2edb2d1dc0276f3953389b18fa3ed38c43184120d0"} Jul 22 15:14:16.688177 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.688081 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.779723 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.779626 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:16.847006 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:16.846913 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:17.151672 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:17.151531 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.176942 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.176908 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.211664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.211613 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:14:18.217431 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.217070 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:14:18.264437 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.264366 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.367815 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.367781 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.531792 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.531630 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.633532 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.633502 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:18.732993 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:18.732963 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:19.054277 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:19.054243 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:19.451531 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:19.451502 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:20.422071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.420916 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:20.507833 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.507768 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:20.629842 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.629789 2542 generic.go:356] "Generic (PLEG): container finished" podID="aeebc12b-214b-4bb5-a264-73999ba52933" containerID="b1591e5f89c310bdf8ca150114e2a70aaecab1172bc62ad749e1b3fc9c8c8b1e" exitCode=0 Jul 22 15:14:20.630021 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.629906 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5pjm" event={"ID":"aeebc12b-214b-4bb5-a264-73999ba52933","Type":"ContainerDied","Data":"b1591e5f89c310bdf8ca150114e2a70aaecab1172bc62ad749e1b3fc9c8c8b1e"} Jul 22 15:14:20.631914 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.631883 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rsf2" event={"ID":"2e29b336-91e6-4afd-b54c-a1bc16a86e89","Type":"ContainerStarted","Data":"1b9130beeaea602dd9d074f6f70770d22810ca57bc8282f6edd29fafd27367e4"} Jul 22 15:14:20.845996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:20.845905 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:21.638797 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:21.638766 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5pjm" event={"ID":"aeebc12b-214b-4bb5-a264-73999ba52933","Type":"ContainerStarted","Data":"fea6fe52c4cae144e02ccd2430c887043fde93b4b2f1aa30b6d8b24d8ba53900"} Jul 22 15:14:21.639199 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:21.638823 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5pjm" event={"ID":"aeebc12b-214b-4bb5-a264-73999ba52933","Type":"ContainerStarted","Data":"a9375eff4c103bfb0f14e97b3710967101c3ee562b294be8f21142d6ece2526c"} Jul 22 15:14:21.669652 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:21.669602 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p5pjm" podStartSLOduration=2.932837262 podStartE2EDuration="6.669587717s" totalImagesPullingTime="3.660686155s" totalInitContainerRuntime="76.0643ms" isStatefulPod=true podCreationTimestamp="2026-07-22 15:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:21.668217576 +0000 UTC m=+92.028299824" watchObservedRunningTime="2026-07-22 15:14:21.669587717 +0000 UTC m=+92.029669965" Jul 22 15:14:21.971307 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:21.971211 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:23.229740 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.229702 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:14:23.233203 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.233182 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.235568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.235544 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 15:14:23.236701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236478 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 15:14:23.236701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236502 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 15:14:23.236701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236550 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 15:14:23.236701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236504 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z9lvv\"" Jul 22 15:14:23.236701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236482 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 15:14:23.237033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236853 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 15:14:23.237033 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.236891 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 15:14:23.241545 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.241055 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 15:14:23.243545 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.243523 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:14:23.399100 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399079 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399204 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399114 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399204 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399138 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399295 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399214 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4wr\" (UniqueName: \"kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399295 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399254 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399295 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399284 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.399411 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.399299 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500229 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500264 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500290 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500443 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500351 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4wr\" (UniqueName: \"kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500443 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500394 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500443 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500419 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.500443 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.500434 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.501081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.501057 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.501344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.501152 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.501344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.501206 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.501344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.501206 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.502822 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.502804 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.503028 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.503011 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.507943 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.507921 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4wr\" (UniqueName: \"kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr\") pod \"console-859bdb747d-qxl69\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.544475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.544453 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:23.649105 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.649077 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rsf2" event={"ID":"2e29b336-91e6-4afd-b54c-a1bc16a86e89","Type":"ContainerStarted","Data":"99de88f6dd1bacc287b56df3f6161bb5472409b70096ca3869f7e81a1b3890ef"} Jul 22 15:14:23.684022 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:23.684002 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:14:23.686229 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:14:23.686206 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9240191_7cf9_40f8_a9b9_a773db8de24d.slice/crio-48efe4116567fff22140f973c72a36c597898c5e38d2f51a90308a8c574befbe WatchSource:0}: Error finding container 48efe4116567fff22140f973c72a36c597898c5e38d2f51a90308a8c574befbe: Status 404 returned error can't find the container with id 48efe4116567fff22140f973c72a36c597898c5e38d2f51a90308a8c574befbe Jul 22 15:14:24.374340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:24.374301 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:24.475612 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:24.475527 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:24.655686 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:24.655585 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859bdb747d-qxl69" event={"ID":"e9240191-7cf9-40f8-a9b9-a773db8de24d","Type":"ContainerStarted","Data":"48efe4116567fff22140f973c72a36c597898c5e38d2f51a90308a8c574befbe"} Jul 22 15:14:25.248313 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:25.248277 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:25.304983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:25.304950 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:27.498620 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:27.498053 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gs9v6" Jul 22 15:14:27.799235 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:27.799139 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:28.113539 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.113497 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:28.212683 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.212625 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:28.314127 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.314085 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:28.672487 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.672456 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859bdb747d-qxl69" event={"ID":"e9240191-7cf9-40f8-a9b9-a773db8de24d","Type":"ContainerStarted","Data":"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8"} Jul 22 15:14:28.674522 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.674501 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rsf2" event={"ID":"2e29b336-91e6-4afd-b54c-a1bc16a86e89","Type":"ContainerStarted","Data":"eb364672c8dcc936bf8de77b96706e819f19ca715cc842e7040b19d18db099a6"} Jul 22 15:14:28.689375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.689330 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-859bdb747d-qxl69" podStartSLOduration=1.2772167890000001 podStartE2EDuration="5.689313924s" totalImagesPullingTime="4.412097135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:28.688349809 +0000 UTC m=+99.048432059" watchObservedRunningTime="2026-07-22 15:14:28.689313924 +0000 UTC m=+99.049396172" Jul 22 15:14:28.704559 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:28.704379 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2rsf2" podStartSLOduration=9.205415947 podStartE2EDuration="22.704361022s" totalImagesPullingTime="13.498945075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:14:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:28.704238323 +0000 UTC m=+99.064320572" watchObservedRunningTime="2026-07-22 15:14:28.704361022 +0000 UTC m=+99.064443272" Jul 22 15:14:33.376120 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.376077 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:33.428894 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.428857 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:33.544987 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.544946 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:33.545290 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.545271 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:33.549999 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.549969 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:33.694924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.694830 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:14:33.843285 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.843248 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:33.947996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:33.947897 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:36.652284 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:36.652249 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:36.729352 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:36.729312 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:36.779666 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:36.779613 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:40.451682 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:40.451625 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:40.520132 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:40.520089 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:43.234198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.234154 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" podUID="b3312c9a-4418-4b63-9e00-61f1bed394e7" containerName="registry" containerID="cri-o://3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493" gracePeriod=30 Jul 22 15:14:43.481515 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.481485 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:14:43.565825 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565794 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.565825 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565830 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565867 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565904 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565947 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqmxh\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.565985 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.566023 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.566050 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token\") pod \"b3312c9a-4418-4b63-9e00-61f1bed394e7\" (UID: \"b3312c9a-4418-4b63-9e00-61f1bed394e7\") " Jul 22 15:14:43.566377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.566343 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:14:43.566738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.566461 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:14:43.569243 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.569217 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:14:43.569352 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.569241 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:14:43.569352 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.569308 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:14:43.569554 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.569533 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh" (OuterVolumeSpecName: "kube-api-access-xqmxh") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "kube-api-access-xqmxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:14:43.569609 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.569535 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:14:43.577151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.577115 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b3312c9a-4418-4b63-9e00-61f1bed394e7" (UID: "b3312c9a-4418-4b63-9e00-61f1bed394e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666673 2542 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-image-registry-private-configuration\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666702 2542 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3312c9a-4418-4b63-9e00-61f1bed394e7-installation-pull-secrets\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666712 2542 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-bound-sa-token\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666722 2542 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666731 2542 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-registry-certificates\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666739 2542 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3312c9a-4418-4b63-9e00-61f1bed394e7-ca-trust-extracted\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666747 2542 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3312c9a-4418-4b63-9e00-61f1bed394e7-trusted-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.666759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.666755 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqmxh\" (UniqueName: \"kubernetes.io/projected/b3312c9a-4418-4b63-9e00-61f1bed394e7-kube-api-access-xqmxh\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:14:43.731297 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.731263 2542 generic.go:356] "Generic (PLEG): container finished" podID="91dbb804-e5c1-49af-b55e-af3209f15a44" containerID="a1ab40bdebdb76e13255b29bb97099a8744a0455d7e55af9a677c3ede6a4f814" exitCode=0 Jul 22 15:14:43.731478 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.731338 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" event={"ID":"91dbb804-e5c1-49af-b55e-af3209f15a44","Type":"ContainerDied","Data":"a1ab40bdebdb76e13255b29bb97099a8744a0455d7e55af9a677c3ede6a4f814"} Jul 22 15:14:43.731790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.731770 2542 scope.go:117] "RemoveContainer" containerID="a1ab40bdebdb76e13255b29bb97099a8744a0455d7e55af9a677c3ede6a4f814" Jul 22 15:14:43.732677 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.732654 2542 generic.go:356] "Generic (PLEG): container finished" podID="b3312c9a-4418-4b63-9e00-61f1bed394e7" containerID="3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493" exitCode=0 Jul 22 15:14:43.732769 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.732707 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" Jul 22 15:14:43.732769 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.732753 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" event={"ID":"b3312c9a-4418-4b63-9e00-61f1bed394e7","Type":"ContainerDied","Data":"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493"} Jul 22 15:14:43.732847 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.732812 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75bdb5864b-7mhm2" event={"ID":"b3312c9a-4418-4b63-9e00-61f1bed394e7","Type":"ContainerDied","Data":"6aee451eaaa0a262a0714c79cc20fc7d822d93c6cce6e6fa2ef53878005154e8"} Jul 22 15:14:43.732847 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.732832 2542 scope.go:117] "RemoveContainer" containerID="3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493" Jul 22 15:14:43.741764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.741741 2542 scope.go:117] "RemoveContainer" containerID="3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493" Jul 22 15:14:43.742089 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:14:43.742069 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493\": container with ID starting with 3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493 not found: ID does not exist" containerID="3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493" Jul 22 15:14:43.742140 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.742100 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493"} err="failed to get container status \"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493\": rpc error: code = NotFound desc = could not find container \"3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493\": container with ID starting with 3d8d659c1b50e6569255c9ebe99aead721fe8a6d4f2bb98e07322bea722c7493 not found: ID does not exist" Jul 22 15:14:43.765570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.765539 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:14:43.770415 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:43.770389 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75bdb5864b-7mhm2"] Jul 22 15:14:44.125371 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:44.125337 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3312c9a-4418-4b63-9e00-61f1bed394e7" path="/var/lib/kubelet/pods/b3312c9a-4418-4b63-9e00-61f1bed394e7/volumes" Jul 22 15:14:44.739310 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:44.739278 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t2mbb" event={"ID":"91dbb804-e5c1-49af-b55e-af3209f15a44","Type":"ContainerStarted","Data":"86fa4b2692cc2a26819fab2e8b1d92f80914f58b60c45a22c770a74f43adb6ec"} Jul 22 15:14:53.774094 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:53.774054 2542 generic.go:356] "Generic (PLEG): container finished" podID="efe62586-cb4c-4815-8680-0fa68b9d311b" containerID="dd5c538028241b2e0b6306857b877c42c7a45f86757cc7694c400b899bd220b0" exitCode=0 Jul 22 15:14:53.774542 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:53.774105 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" event={"ID":"efe62586-cb4c-4815-8680-0fa68b9d311b","Type":"ContainerDied","Data":"dd5c538028241b2e0b6306857b877c42c7a45f86757cc7694c400b899bd220b0"} Jul 22 15:14:53.774542 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:53.774444 2542 scope.go:117] "RemoveContainer" containerID="dd5c538028241b2e0b6306857b877c42c7a45f86757cc7694c400b899bd220b0" Jul 22 15:14:54.778818 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:54.778784 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zkwc6" event={"ID":"efe62586-cb4c-4815-8680-0fa68b9d311b","Type":"ContainerStarted","Data":"9b2e2abddc97d8009e42a7db2b9065640752acf21c431652162ae2220715e610"} Jul 22 15:14:55.251941 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:55.251908 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:14:55.311418 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:14:55.311378 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:03.486217 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:03.486179 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:03.604228 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:03.604193 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:03.663849 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:03.663816 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:25.826680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:25.826623 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:34.963865 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:34.963817 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:35.065531 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:35.065498 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:36.805202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:36.805160 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:36.868544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:36.868512 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:40.054651 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.054610 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-866b5cc8cc-hq48r"] Jul 22 15:15:40.055014 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.054898 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3312c9a-4418-4b63-9e00-61f1bed394e7" containerName="registry" Jul 22 15:15:40.055014 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.054911 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3312c9a-4418-4b63-9e00-61f1bed394e7" containerName="registry" Jul 22 15:15:40.055014 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.054959 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3312c9a-4418-4b63-9e00-61f1bed394e7" containerName="registry" Jul 22 15:15:40.058014 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.057997 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.060503 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060484 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 15:15:40.060614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060516 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 15:15:40.060614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060519 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 15:15:40.060776 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060757 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 15:15:40.060935 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060916 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gfqpb\"" Jul 22 15:15:40.061053 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.060955 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 15:15:40.067171 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.067155 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 15:15:40.071475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.071448 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-866b5cc8cc-hq48r"] Jul 22 15:15:40.218802 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218768 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.218981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218829 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.218981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218860 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.218981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218878 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.218981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218898 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fqp5\" (UniqueName: \"kubernetes.io/projected/1668494c-b8b6-4461-9661-3afc6a9f8b8a-kube-api-access-4fqp5\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.218981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218926 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-federate-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.219139 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.218990 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-metrics-client-ca\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.219139 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.219044 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-serving-certs-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320077 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320127 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fqp5\" (UniqueName: \"kubernetes.io/projected/1668494c-b8b6-4461-9661-3afc6a9f8b8a-kube-api-access-4fqp5\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320154 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-federate-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320182 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-metrics-client-ca\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320227 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-serving-certs-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320261 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320318 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.320410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.320342 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.321176 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.321144 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-metrics-client-ca\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.321282 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.321217 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.321586 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.321566 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1668494c-b8b6-4461-9661-3afc6a9f8b8a-serving-certs-ca-bundle\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.322914 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.322882 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-telemeter-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.323076 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.323041 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.323368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.323351 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-secret-telemeter-client\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.323421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.323381 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1668494c-b8b6-4461-9661-3afc6a9f8b8a-federate-client-tls\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.328773 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.328752 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fqp5\" (UniqueName: \"kubernetes.io/projected/1668494c-b8b6-4461-9661-3afc6a9f8b8a-kube-api-access-4fqp5\") pod \"telemeter-client-866b5cc8cc-hq48r\" (UID: \"1668494c-b8b6-4461-9661-3afc6a9f8b8a\") " pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.368703 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.368667 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" Jul 22 15:15:40.514592 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.514556 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-866b5cc8cc-hq48r"] Jul 22 15:15:40.517773 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:15:40.517746 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1668494c_b8b6_4461_9661_3afc6a9f8b8a.slice/crio-43da186b6eae9724e52ee6a87ff6d86e78d57a1d6f0a47729d2e0329615edac1 WatchSource:0}: Error finding container 43da186b6eae9724e52ee6a87ff6d86e78d57a1d6f0a47729d2e0329615edac1: Status 404 returned error can't find the container with id 43da186b6eae9724e52ee6a87ff6d86e78d57a1d6f0a47729d2e0329615edac1 Jul 22 15:15:40.941395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:40.941354 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" event={"ID":"1668494c-b8b6-4461-9661-3afc6a9f8b8a","Type":"ContainerStarted","Data":"43da186b6eae9724e52ee6a87ff6d86e78d57a1d6f0a47729d2e0329615edac1"} Jul 22 15:15:43.954743 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:43.954705 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" event={"ID":"1668494c-b8b6-4461-9661-3afc6a9f8b8a","Type":"ContainerStarted","Data":"94e9b790a7723abf62d563da9d36901febe352d3a68a0b1b61c7d218c15882bd"} Jul 22 15:15:44.960317 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:44.960281 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" event={"ID":"1668494c-b8b6-4461-9661-3afc6a9f8b8a","Type":"ContainerStarted","Data":"1d89bea64db69ee3a8230785e96dbc367dce327419d4e9155c7590164cc8274f"} Jul 22 15:15:44.960720 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:44.960370 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" event={"ID":"1668494c-b8b6-4461-9661-3afc6a9f8b8a","Type":"ContainerStarted","Data":"0acf98979d80736ca5808c02c5258865eb3e0aab48c2a9820b8b43d58d5b9e07"} Jul 22 15:15:44.987505 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:44.987450 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-866b5cc8cc-hq48r" podStartSLOduration=1.128730359 podStartE2EDuration="4.98743359s" totalImagesPullingTime="3.858703231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:15:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:15:44.985890707 +0000 UTC m=+175.345972956" watchObservedRunningTime="2026-07-22 15:15:44.98743359 +0000 UTC m=+175.347515839" Jul 22 15:15:46.011379 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.011346 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:15:46.014734 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.014708 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.028630 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.028609 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:15:46.069869 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.069835 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070086 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.069898 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070086 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.069956 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070086 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.070041 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070086 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.070074 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070292 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.070093 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.070292 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.070271 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g26b\" (UniqueName: \"kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.093235 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.093207 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:46.171603 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171567 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g26b\" (UniqueName: \"kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171614 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171680 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171706 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171731 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171752 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.171820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.171777 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.172540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.172482 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.172540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.172580 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.172540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.172592 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.172898 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.172835 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.174539 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.174514 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.174619 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.174597 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.181461 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.181442 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g26b\" (UniqueName: \"kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b\") pod \"console-844c76c7db-jnhgp\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.193735 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.193705 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:46.277405 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.277314 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:46.325984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.325956 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:46.468064 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.468021 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:15:46.474813 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:15:46.474788 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fafdc80_3241_4b40_957d_8c863b2e4f5c.slice/crio-4569355254fd873839da0151747626faa59f74f929687e24ac6d999a7e41053c WatchSource:0}: Error finding container 4569355254fd873839da0151747626faa59f74f929687e24ac6d999a7e41053c: Status 404 returned error can't find the container with id 4569355254fd873839da0151747626faa59f74f929687e24ac6d999a7e41053c Jul 22 15:15:46.852429 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.852396 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:46.924571 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.924537 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:46.970530 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.970501 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844c76c7db-jnhgp" event={"ID":"7fafdc80-3241-4b40-957d-8c863b2e4f5c","Type":"ContainerStarted","Data":"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598"} Jul 22 15:15:46.970720 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.970554 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844c76c7db-jnhgp" event={"ID":"7fafdc80-3241-4b40-957d-8c863b2e4f5c","Type":"ContainerStarted","Data":"4569355254fd873839da0151747626faa59f74f929687e24ac6d999a7e41053c"} Jul 22 15:15:46.989322 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:46.989273 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844c76c7db-jnhgp" podStartSLOduration=1.9892564190000002 podStartE2EDuration="1.989256419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:15:46.988277457 +0000 UTC m=+177.348359734" watchObservedRunningTime="2026-07-22 15:15:46.989256419 +0000 UTC m=+177.349338668" Jul 22 15:15:56.326734 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:56.326690 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:56.327163 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:56.326772 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:56.331723 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:56.331700 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:57.011843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:57.011817 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:15:57.057903 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:57.057867 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:15:57.163383 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:57.163349 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:57.215861 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:57.215827 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:15:57.276007 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:15:57.275900 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:16:22.086965 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.086920 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-859bdb747d-qxl69" podUID="e9240191-7cf9-40f8-a9b9-a773db8de24d" containerName="console" containerID="cri-o://467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8" gracePeriod=15 Jul 22 15:16:22.324959 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.324937 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:16:22.446994 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.446922 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk4wr\" (UniqueName: \"kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.446994 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.446958 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447213 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447004 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447213 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447030 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447213 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447057 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447213 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447106 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447213 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447129 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert\") pod \"e9240191-7cf9-40f8-a9b9-a773db8de24d\" (UID: \"e9240191-7cf9-40f8-a9b9-a773db8de24d\") " Jul 22 15:16:22.447512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447485 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config" (OuterVolumeSpecName: "console-config") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:16:22.447569 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447507 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:16:22.447569 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447516 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:16:22.447569 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.447523 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:16:22.449425 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.449397 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:16:22.449425 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.449419 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr" (OuterVolumeSpecName: "kube-api-access-zk4wr") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "kube-api-access-zk4wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:16:22.449559 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.449421 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9240191-7cf9-40f8-a9b9-a773db8de24d" (UID: "e9240191-7cf9-40f8-a9b9-a773db8de24d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:16:22.548191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548156 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk4wr\" (UniqueName: \"kubernetes.io/projected/e9240191-7cf9-40f8-a9b9-a773db8de24d-kube-api-access-zk4wr\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548187 2542 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-oauth-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548197 2542 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548208 2542 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548216 2542 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-trusted-ca-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548224 2542 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9240191-7cf9-40f8-a9b9-a773db8de24d-oauth-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:22.548356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:22.548233 2542 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9240191-7cf9-40f8-a9b9-a773db8de24d-console-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:16:23.101005 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.100978 2542 generic.go:356] "Generic (PLEG): container finished" podID="e9240191-7cf9-40f8-a9b9-a773db8de24d" containerID="467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8" exitCode=0 Jul 22 15:16:23.101356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.101027 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859bdb747d-qxl69" Jul 22 15:16:23.101356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.101049 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859bdb747d-qxl69" event={"ID":"e9240191-7cf9-40f8-a9b9-a773db8de24d","Type":"ContainerDied","Data":"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8"} Jul 22 15:16:23.101356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.101088 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859bdb747d-qxl69" event={"ID":"e9240191-7cf9-40f8-a9b9-a773db8de24d","Type":"ContainerDied","Data":"48efe4116567fff22140f973c72a36c597898c5e38d2f51a90308a8c574befbe"} Jul 22 15:16:23.101356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.101108 2542 scope.go:117] "RemoveContainer" containerID="467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8" Jul 22 15:16:23.109551 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.109534 2542 scope.go:117] "RemoveContainer" containerID="467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8" Jul 22 15:16:23.109836 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:16:23.109816 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8\": container with ID starting with 467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8 not found: ID does not exist" containerID="467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8" Jul 22 15:16:23.109895 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.109844 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8"} err="failed to get container status \"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8\": rpc error: code = NotFound desc = could not find container \"467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8\": container with ID starting with 467f4a3fb5acb2774f99361453d0513bf94901941291eb15db7f556ff0a91bd8 not found: ID does not exist" Jul 22 15:16:23.121483 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.121464 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:16:23.124842 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:23.124815 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-859bdb747d-qxl69"] Jul 22 15:16:24.121191 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:24.121156 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9240191-7cf9-40f8-a9b9-a773db8de24d" path="/var/lib/kubelet/pods/e9240191-7cf9-40f8-a9b9-a773db8de24d/volumes" Jul 22 15:16:50.211454 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:50.211416 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:16:50.272542 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:16:50.272507 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:02.085252 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:02.085210 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:02.142497 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:02.142468 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:03.494012 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.493982 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:17:03.494375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.494260 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9240191-7cf9-40f8-a9b9-a773db8de24d" containerName="console" Jul 22 15:17:03.494375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.494272 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9240191-7cf9-40f8-a9b9-a773db8de24d" containerName="console" Jul 22 15:17:03.494375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.494317 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9240191-7cf9-40f8-a9b9-a773db8de24d" containerName="console" Jul 22 15:17:03.498622 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.498603 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.508305 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.508284 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:17:03.550899 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.550871 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:03.622262 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622241 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622357 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622269 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hww5b\" (UniqueName: \"kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622357 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622289 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622357 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622338 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622457 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622497 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.622610 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.622530 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723336 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723312 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723341 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723360 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723383 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723402 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hww5b\" (UniqueName: \"kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723420 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.723446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.723440 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.724236 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.724177 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.724338 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.724243 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.724399 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.724352 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.724460 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.724407 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.726297 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.726269 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.726383 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.726337 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.727499 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.727473 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:03.731421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.731399 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hww5b\" (UniqueName: \"kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b\") pod \"console-6976f8c878-qkvxd\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.792387 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.792328 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:03.807048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.807027 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:03.935880 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:03.935858 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:17:03.938453 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:17:03.938428 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02a361e_aa4b_4240_a47e_f5665470709b.slice/crio-48c9237f7f4dd1c136281b41ed991218f3d58af1160cd6a5f3d6fa6bc2cd496f WatchSource:0}: Error finding container 48c9237f7f4dd1c136281b41ed991218f3d58af1160cd6a5f3d6fa6bc2cd496f: Status 404 returned error can't find the container with id 48c9237f7f4dd1c136281b41ed991218f3d58af1160cd6a5f3d6fa6bc2cd496f Jul 22 15:17:04.239874 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:04.239845 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976f8c878-qkvxd" event={"ID":"f02a361e-aa4b-4240-a47e-f5665470709b","Type":"ContainerStarted","Data":"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f"} Jul 22 15:17:04.240029 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:04.239884 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976f8c878-qkvxd" event={"ID":"f02a361e-aa4b-4240-a47e-f5665470709b","Type":"ContainerStarted","Data":"48c9237f7f4dd1c136281b41ed991218f3d58af1160cd6a5f3d6fa6bc2cd496f"} Jul 22 15:17:04.258583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:04.258538 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6976f8c878-qkvxd" podStartSLOduration=1.258523219 podStartE2EDuration="1.258523219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:17:04.25761839 +0000 UTC m=+254.617700638" watchObservedRunningTime="2026-07-22 15:17:04.258523219 +0000 UTC m=+254.618605467" Jul 22 15:17:04.341204 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:04.341178 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:04.393026 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:04.392997 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:10.325703 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:10.325669 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:10.427103 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:10.427054 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:13.808040 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:13.807936 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:13.808040 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:13.808004 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:13.813195 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:13.813169 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:14.279825 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:14.279790 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:17:14.325851 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:14.325825 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:17:14.421530 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:14.421498 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:14.523182 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:14.523138 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:14.574502 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:14.574433 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:17:39.347821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.347759 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-844c76c7db-jnhgp" podUID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" containerName="console" containerID="cri-o://192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598" gracePeriod=15 Jul 22 15:17:39.593442 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.593419 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:17:39.674679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674592 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674650 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g26b\" (UniqueName: \"kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674673 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674689 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674707 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674793 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.674924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.674839 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config\") pod \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\" (UID: \"7fafdc80-3241-4b40-957d-8c863b2e4f5c\") " Jul 22 15:17:39.675250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.675142 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:17:39.675535 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.675161 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:17:39.675535 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.675248 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:17:39.675535 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.675292 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config" (OuterVolumeSpecName: "console-config") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:17:39.676931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.676904 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b" (OuterVolumeSpecName: "kube-api-access-9g26b") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "kube-api-access-9g26b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:17:39.677034 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.676951 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:17:39.677034 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.677000 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7fafdc80-3241-4b40-957d-8c863b2e4f5c" (UID: "7fafdc80-3241-4b40-957d-8c863b2e4f5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:17:39.775624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775586 2542 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775621 2542 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-oauth-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775659 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g26b\" (UniqueName: \"kubernetes.io/projected/7fafdc80-3241-4b40-957d-8c863b2e4f5c-kube-api-access-9g26b\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775674 2542 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-oauth-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775685 2542 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775697 2542 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7fafdc80-3241-4b40-957d-8c863b2e4f5c-console-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:39.775790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:39.775707 2542 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fafdc80-3241-4b40-957d-8c863b2e4f5c-trusted-ca-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:17:40.368218 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.368185 2542 generic.go:356] "Generic (PLEG): container finished" podID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" containerID="192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598" exitCode=0 Jul 22 15:17:40.368610 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.368228 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844c76c7db-jnhgp" event={"ID":"7fafdc80-3241-4b40-957d-8c863b2e4f5c","Type":"ContainerDied","Data":"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598"} Jul 22 15:17:40.368610 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.368233 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844c76c7db-jnhgp" Jul 22 15:17:40.368610 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.368267 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844c76c7db-jnhgp" event={"ID":"7fafdc80-3241-4b40-957d-8c863b2e4f5c","Type":"ContainerDied","Data":"4569355254fd873839da0151747626faa59f74f929687e24ac6d999a7e41053c"} Jul 22 15:17:40.368610 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.368288 2542 scope.go:117] "RemoveContainer" containerID="192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598" Jul 22 15:17:40.376480 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.376465 2542 scope.go:117] "RemoveContainer" containerID="192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598" Jul 22 15:17:40.376729 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:17:40.376709 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598\": container with ID starting with 192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598 not found: ID does not exist" containerID="192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598" Jul 22 15:17:40.376819 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.376734 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598"} err="failed to get container status \"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598\": rpc error: code = NotFound desc = could not find container \"192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598\": container with ID starting with 192712e1c2ed7cfbd16c76e238c186f5785ca5fefbf48f59ed140787f161c598 not found: ID does not exist" Jul 22 15:17:40.385711 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.385665 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:17:40.390744 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:40.390725 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844c76c7db-jnhgp"] Jul 22 15:17:42.121582 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:42.121549 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" path="/var/lib/kubelet/pods/7fafdc80-3241-4b40-957d-8c863b2e4f5c/volumes" Jul 22 15:17:50.028113 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:50.028084 2542 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 15:17:57.247918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:17:57.247868 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:03.909803 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:03.909771 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:04.001028 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.001001 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:04.634786 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.634751 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7"] Jul 22 15:18:04.635045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.635031 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" containerName="console" Jul 22 15:18:04.635100 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.635048 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" containerName="console" Jul 22 15:18:04.635137 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.635111 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fafdc80-3241-4b40-957d-8c863b2e4f5c" containerName="console" Jul 22 15:18:04.638147 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.638131 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.640597 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.640574 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 15:18:04.640597 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.640588 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9w875\"" Jul 22 15:18:04.641480 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.641460 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 15:18:04.649250 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.648675 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7"] Jul 22 15:18:04.743565 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.743527 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qv6w\" (UniqueName: \"kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.743565 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.743575 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.743771 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.743613 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.844202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.844163 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.844334 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.844217 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv6w\" (UniqueName: \"kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.844396 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.844329 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.844598 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.844579 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.844695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.844608 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.852892 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.852872 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qv6w\" (UniqueName: \"kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:04.951818 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:04.951729 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:05.080689 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:05.080615 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7"] Jul 22 15:18:05.082892 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:05.082864 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3743788c_7c60_4b8a_98ce_38538a367a19.slice/crio-b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4 WatchSource:0}: Error finding container b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4: Status 404 returned error can't find the container with id b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4 Jul 22 15:18:05.084796 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:05.084781 2542 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 15:18:05.457875 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:05.457846 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" event={"ID":"3743788c-7c60-4b8a-98ce-38538a367a19","Type":"ContainerStarted","Data":"b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4"} Jul 22 15:18:12.487057 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:12.487020 2542 generic.go:356] "Generic (PLEG): container finished" podID="3743788c-7c60-4b8a-98ce-38538a367a19" containerID="6ceb1bdb05bf9ebede505c6bd5980aed65df3607de8788df5e8dbb16d9435f43" exitCode=0 Jul 22 15:18:12.487395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:12.487061 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" event={"ID":"3743788c-7c60-4b8a-98ce-38538a367a19","Type":"ContainerDied","Data":"6ceb1bdb05bf9ebede505c6bd5980aed65df3607de8788df5e8dbb16d9435f43"} Jul 22 15:18:15.501094 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:15.501060 2542 generic.go:356] "Generic (PLEG): container finished" podID="3743788c-7c60-4b8a-98ce-38538a367a19" containerID="cdd87c416e2b47952ae473467280ecbe8d81e2da52c08042afbbdebf2d086890" exitCode=0 Jul 22 15:18:15.501475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:15.501150 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" event={"ID":"3743788c-7c60-4b8a-98ce-38538a367a19","Type":"ContainerDied","Data":"cdd87c416e2b47952ae473467280ecbe8d81e2da52c08042afbbdebf2d086890"} Jul 22 15:18:23.533948 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:23.533880 2542 generic.go:356] "Generic (PLEG): container finished" podID="3743788c-7c60-4b8a-98ce-38538a367a19" containerID="be3be39649e482155fec1280335552cf56fd78c8d5b0707f560789bfa325e3ea" exitCode=0 Jul 22 15:18:23.533948 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:23.533917 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" event={"ID":"3743788c-7c60-4b8a-98ce-38538a367a19","Type":"ContainerDied","Data":"be3be39649e482155fec1280335552cf56fd78c8d5b0707f560789bfa325e3ea"} Jul 22 15:18:24.659704 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.659683 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:24.804808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.804736 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle\") pod \"3743788c-7c60-4b8a-98ce-38538a367a19\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " Jul 22 15:18:24.804808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.804785 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qv6w\" (UniqueName: \"kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w\") pod \"3743788c-7c60-4b8a-98ce-38538a367a19\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " Jul 22 15:18:24.804984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.804840 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util\") pod \"3743788c-7c60-4b8a-98ce-38538a367a19\" (UID: \"3743788c-7c60-4b8a-98ce-38538a367a19\") " Jul 22 15:18:24.805374 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.805337 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle" (OuterVolumeSpecName: "bundle") pod "3743788c-7c60-4b8a-98ce-38538a367a19" (UID: "3743788c-7c60-4b8a-98ce-38538a367a19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:18:24.807048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.807025 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w" (OuterVolumeSpecName: "kube-api-access-7qv6w") pod "3743788c-7c60-4b8a-98ce-38538a367a19" (UID: "3743788c-7c60-4b8a-98ce-38538a367a19"). InnerVolumeSpecName "kube-api-access-7qv6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:18:24.808880 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.808857 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util" (OuterVolumeSpecName: "util") pod "3743788c-7c60-4b8a-98ce-38538a367a19" (UID: "3743788c-7c60-4b8a-98ce-38538a367a19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:18:24.905724 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.905692 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:24.905724 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.905718 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3743788c-7c60-4b8a-98ce-38538a367a19-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:24.905724 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:24.905727 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qv6w\" (UniqueName: \"kubernetes.io/projected/3743788c-7c60-4b8a-98ce-38538a367a19-kube-api-access-7qv6w\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:25.543228 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:25.543193 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" event={"ID":"3743788c-7c60-4b8a-98ce-38538a367a19","Type":"ContainerDied","Data":"b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4"} Jul 22 15:18:25.543422 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:25.543245 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8b9d2410a6b043ab142bbce4963880e45702c310949e32d9ed8588bb4b084a4" Jul 22 15:18:25.543422 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:25.543204 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p75n7" Jul 22 15:18:30.754286 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:30.754251 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:31.550436 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:31.550397 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:32.694526 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694492 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh"] Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694786 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="pull" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694797 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="pull" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694818 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="extract" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694823 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="extract" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694831 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="util" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694837 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="util" Jul 22 15:18:32.694938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.694887 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="3743788c-7c60-4b8a-98ce-38538a367a19" containerName="extract" Jul 22 15:18:32.699020 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.699003 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.702179 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.702157 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8q9j9\"" Jul 22 15:18:32.702485 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.702467 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 15:18:32.702485 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.702477 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:18:32.727954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.727929 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh"] Jul 22 15:18:32.855231 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.855206 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rf9\" (UniqueName: \"kubernetes.io/projected/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-kube-api-access-v6rf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.855332 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.855270 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.956056 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.956002 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.956056 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.956031 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rf9\" (UniqueName: \"kubernetes.io/projected/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-kube-api-access-v6rf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.956371 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.956353 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:32.967808 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:32.967783 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rf9\" (UniqueName: \"kubernetes.io/projected/e0b27c5c-63e2-4db2-afc9-04d8bdb9e873-kube-api-access-v6rf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-rbnsh\" (UID: \"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:33.009004 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:33.008984 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" Jul 22 15:18:33.137376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:33.137346 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh"] Jul 22 15:18:33.140409 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:33.140381 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b27c5c_63e2_4db2_afc9_04d8bdb9e873.slice/crio-e44b95b2575612c5d96b5735a049614f412bb089f579befba2c7c08b71684f4b WatchSource:0}: Error finding container e44b95b2575612c5d96b5735a049614f412bb089f579befba2c7c08b71684f4b: Status 404 returned error can't find the container with id e44b95b2575612c5d96b5735a049614f412bb089f579befba2c7c08b71684f4b Jul 22 15:18:33.574173 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:33.574135 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" event={"ID":"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873","Type":"ContainerStarted","Data":"e44b95b2575612c5d96b5735a049614f412bb089f579befba2c7c08b71684f4b"} Jul 22 15:18:34.275145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:34.275107 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:34.327899 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:34.327859 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:35.586296 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:35.586251 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" event={"ID":"e0b27c5c-63e2-4db2-afc9-04d8bdb9e873","Type":"ContainerStarted","Data":"82e97a18cd8ed57e389a33320914064ea933979f778ebbcc2ec6c77d0420e14b"} Jul 22 15:18:35.608037 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:35.607989 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rbnsh" podStartSLOduration=1.979967305 podStartE2EDuration="3.607974035s" totalImagesPullingTime="1.62800673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:18:35.606835463 +0000 UTC m=+345.966917741" watchObservedRunningTime="2026-07-22 15:18:35.607974035 +0000 UTC m=+345.968056284" Jul 22 15:18:35.945775 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:35.945697 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:36.095589 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.095560 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:36.506858 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.506825 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77"] Jul 22 15:18:36.509204 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.509189 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.511625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.511603 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 15:18:36.512520 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.512503 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 15:18:36.512520 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.512517 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9w875\"" Jul 22 15:18:36.519209 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.519190 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77"] Jul 22 15:18:36.581456 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.581433 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.581570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.581480 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgz7h\" (UniqueName: \"kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.581570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.581554 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.610196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.610160 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:36.681957 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.681936 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgz7h\" (UniqueName: \"kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.682043 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.681982 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.682086 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.682039 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.682402 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.682386 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.682446 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.682419 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.694902 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.694883 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgz7h\" (UniqueName: \"kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.735541 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.735520 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:36.819176 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.819123 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:36.948522 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:36.948494 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77"] Jul 22 15:18:36.950775 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:36.950751 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa02455_80fb_4f45_9b79_ad8f3ba7b8f2.slice/crio-1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d WatchSource:0}: Error finding container 1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d: Status 404 returned error can't find the container with id 1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d Jul 22 15:18:37.594769 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:37.594736 2542 generic.go:356] "Generic (PLEG): container finished" podID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerID="34500108abd9ed709a50dcfbddea4921b8a18b6462122282e9aea92e85513059" exitCode=0 Jul 22 15:18:37.594971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:37.594829 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" event={"ID":"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2","Type":"ContainerDied","Data":"34500108abd9ed709a50dcfbddea4921b8a18b6462122282e9aea92e85513059"} Jul 22 15:18:37.594971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:37.594868 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" event={"ID":"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2","Type":"ContainerStarted","Data":"1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d"} Jul 22 15:18:38.614444 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:38.614386 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:39.031395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:39.031324 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:40.609548 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:40.609513 2542 generic.go:356] "Generic (PLEG): container finished" podID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerID="0989e13e85bc914d8dacefefac4142b8ae1fb2d70d3e454b1f013cd1e18fdea2" exitCode=0 Jul 22 15:18:40.609927 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:40.609567 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" event={"ID":"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2","Type":"ContainerDied","Data":"0989e13e85bc914d8dacefefac4142b8ae1fb2d70d3e454b1f013cd1e18fdea2"} Jul 22 15:18:41.615897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:41.615821 2542 generic.go:356] "Generic (PLEG): container finished" podID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerID="952a66c291a17a7d4448d19211edc8695eae0eda42a12298eed3365d04eb4f4f" exitCode=0 Jul 22 15:18:41.615897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:41.615886 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" event={"ID":"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2","Type":"ContainerDied","Data":"952a66c291a17a7d4448d19211edc8695eae0eda42a12298eed3365d04eb4f4f"} Jul 22 15:18:41.662787 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:41.662761 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:41.740862 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:41.740834 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:42.743324 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.743299 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:42.827279 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.827249 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgz7h\" (UniqueName: \"kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h\") pod \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " Jul 22 15:18:42.827437 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.827314 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util\") pod \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " Jul 22 15:18:42.827437 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.827345 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle\") pod \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\" (UID: \"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2\") " Jul 22 15:18:42.827811 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.827786 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle" (OuterVolumeSpecName: "bundle") pod "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" (UID: "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:18:42.829468 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.829434 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h" (OuterVolumeSpecName: "kube-api-access-jgz7h") pod "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" (UID: "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2"). InnerVolumeSpecName "kube-api-access-jgz7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:18:42.831877 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.831854 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util" (OuterVolumeSpecName: "util") pod "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" (UID: "6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:18:42.928157 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.928088 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgz7h\" (UniqueName: \"kubernetes.io/projected/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-kube-api-access-jgz7h\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:42.928157 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.928111 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:42.928157 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:42.928121 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:18:43.626221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:43.626177 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" event={"ID":"6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2","Type":"ContainerDied","Data":"1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d"} Jul 22 15:18:43.626221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:43.626204 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxl77" Jul 22 15:18:43.626426 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:43.626235 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fc43a3ab7c831598d84ff1e63724c1a97c6e0c88e8a53c6d309af9f2b28547d" Jul 22 15:18:44.908549 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908509 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr"] Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908792 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="extract" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908804 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="extract" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908821 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="util" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908826 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="util" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908832 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="pull" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908837 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="pull" Jul 22 15:18:44.908954 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.908885 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa02455-80fb-4f45-9b79-ad8f3ba7b8f2" containerName="extract" Jul 22 15:18:44.912390 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.912375 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:44.914729 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.914710 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 15:18:44.915601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.915586 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-chzzn\"" Jul 22 15:18:44.915706 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.915590 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 15:18:44.921484 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:44.921464 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr"] Jul 22 15:18:45.043200 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.043174 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtsnr\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-kube-api-access-rtsnr\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.043311 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.043206 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.144260 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.144227 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtsnr\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-kube-api-access-rtsnr\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.144370 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.144273 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.153681 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.153653 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.153915 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.153894 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtsnr\" (UniqueName: \"kubernetes.io/projected/7366fc66-47b2-4bab-b83e-86f5cbf56210-kube-api-access-rtsnr\") pod \"cert-manager-cainjector-559cdd8c87-x8xfr\" (UID: \"7366fc66-47b2-4bab-b83e-86f5cbf56210\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.221818 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.221761 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" Jul 22 15:18:45.350784 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.350737 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr"] Jul 22 15:18:45.357006 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:45.356979 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7366fc66_47b2_4bab_b83e_86f5cbf56210.slice/crio-d90941741abb75575b8bc01c7c79bbfebfd13d0f1660caa7c73b491bdab91f02 WatchSource:0}: Error finding container d90941741abb75575b8bc01c7c79bbfebfd13d0f1660caa7c73b491bdab91f02: Status 404 returned error can't find the container with id d90941741abb75575b8bc01c7c79bbfebfd13d0f1660caa7c73b491bdab91f02 Jul 22 15:18:45.635413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:45.635378 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" event={"ID":"7366fc66-47b2-4bab-b83e-86f5cbf56210","Type":"ContainerStarted","Data":"d90941741abb75575b8bc01c7c79bbfebfd13d0f1660caa7c73b491bdab91f02"} Jul 22 15:18:47.206340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:47.206303 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:47.307268 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:47.307226 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:47.407475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:47.407436 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:48.636393 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:48.636358 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:48.649953 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:48.649925 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" event={"ID":"7366fc66-47b2-4bab-b83e-86f5cbf56210","Type":"ContainerStarted","Data":"fecde2e217414e8703e0339ff55d4462cb574be5ecb42982878107d354735b3d"} Jul 22 15:18:48.665490 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:48.665453 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x8xfr" podStartSLOduration=2.258629642 podStartE2EDuration="4.665438845s" totalImagesPullingTime="2.406809203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:18:48.665362637 +0000 UTC m=+359.025444886" watchObservedRunningTime="2026-07-22 15:18:48.665438845 +0000 UTC m=+359.025521094" Jul 22 15:18:48.736545 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:48.736518 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:49.511688 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.511650 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm"] Jul 22 15:18:49.514898 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.514877 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.517614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.517582 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 15:18:49.517614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.517603 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2glpb\"" Jul 22 15:18:49.517614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.517585 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 15:18:49.522730 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.522712 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm"] Jul 22 15:18:49.680873 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.680854 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb868\" (UniqueName: \"kubernetes.io/projected/da059464-73d5-4f21-9d5c-cf9b00813038-kube-api-access-bb868\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.681158 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.680881 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da059464-73d5-4f21-9d5c-cf9b00813038-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.781277 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.781223 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb868\" (UniqueName: \"kubernetes.io/projected/da059464-73d5-4f21-9d5c-cf9b00813038-kube-api-access-bb868\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.781277 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.781263 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da059464-73d5-4f21-9d5c-cf9b00813038-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.781602 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.781586 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da059464-73d5-4f21-9d5c-cf9b00813038-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.789995 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.789976 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb868\" (UniqueName: \"kubernetes.io/projected/da059464-73d5-4f21-9d5c-cf9b00813038-kube-api-access-bb868\") pod \"openshift-lws-operator-fd8ccff4c-8cvcm\" (UID: \"da059464-73d5-4f21-9d5c-cf9b00813038\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.823806 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.823786 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" Jul 22 15:18:49.951796 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:49.951773 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm"] Jul 22 15:18:49.953576 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:49.953551 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda059464_73d5_4f21_9d5c_cf9b00813038.slice/crio-ee631dfb5ada6e20a4a139091f40d9ef80baf4d09fd350f90c7497174eb987f7 WatchSource:0}: Error finding container ee631dfb5ada6e20a4a139091f40d9ef80baf4d09fd350f90c7497174eb987f7: Status 404 returned error can't find the container with id ee631dfb5ada6e20a4a139091f40d9ef80baf4d09fd350f90c7497174eb987f7 Jul 22 15:18:50.659626 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:50.659589 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" event={"ID":"da059464-73d5-4f21-9d5c-cf9b00813038","Type":"ContainerStarted","Data":"ee631dfb5ada6e20a4a139091f40d9ef80baf4d09fd350f90c7497174eb987f7"} Jul 22 15:18:52.671140 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:52.671105 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" event={"ID":"da059464-73d5-4f21-9d5c-cf9b00813038","Type":"ContainerStarted","Data":"c4c0cc70cbed09237aaa588edadcbecbd6086367d04df18fa791f31bfce32413"} Jul 22 15:18:52.688265 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:52.688215 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cvcm" podStartSLOduration=1.102530688 podStartE2EDuration="3.688195819s" totalImagesPullingTime="2.585665131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:18:52.686266017 +0000 UTC m=+363.046348266" watchObservedRunningTime="2026-07-22 15:18:52.688195819 +0000 UTC m=+363.048278069" Jul 22 15:18:53.374550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:53.374515 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:53.474417 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:53.474382 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:55.623527 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:55.623492 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:18:57.358841 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.358809 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj"] Jul 22 15:18:57.361627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.361611 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.364165 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.364145 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 15:18:57.364482 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.364465 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 15:18:57.365132 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.365113 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9w875\"" Jul 22 15:18:57.370398 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.370375 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj"] Jul 22 15:18:57.539219 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.539191 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gmw\" (UniqueName: \"kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.539370 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.539233 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.539370 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.539280 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.640129 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.640061 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.640129 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.640105 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gmw\" (UniqueName: \"kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.640285 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.640134 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.640406 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.640389 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.640461 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.640445 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.648196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.648171 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gmw\" (UniqueName: \"kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.670923 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.670901 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:18:57.806116 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:57.806091 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj"] Jul 22 15:18:57.808144 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:18:57.808118 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf67618e_3ddb_4ffb_8959_f6f218da5618.slice/crio-bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515 WatchSource:0}: Error finding container bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515: Status 404 returned error can't find the container with id bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515 Jul 22 15:18:58.703395 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:58.703360 2542 generic.go:356] "Generic (PLEG): container finished" podID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerID="c8169c992f5a26f4a54b7f8b0ff7e21516d185c14c9b28d9d18048d0c6a88aa3" exitCode=0 Jul 22 15:18:58.703717 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:58.703409 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" event={"ID":"af67618e-3ddb-4ffb-8959-f6f218da5618","Type":"ContainerDied","Data":"c8169c992f5a26f4a54b7f8b0ff7e21516d185c14c9b28d9d18048d0c6a88aa3"} Jul 22 15:18:58.703717 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:58.703457 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" event={"ID":"af67618e-3ddb-4ffb-8959-f6f218da5618","Type":"ContainerStarted","Data":"bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515"} Jul 22 15:18:59.709904 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:59.709828 2542 generic.go:356] "Generic (PLEG): container finished" podID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerID="37d6e4a832a95d0832e73bc11560d7b972ff267e13df425e64e9cdcb08ddd058" exitCode=0 Jul 22 15:18:59.710202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:18:59.709911 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" event={"ID":"af67618e-3ddb-4ffb-8959-f6f218da5618","Type":"ContainerDied","Data":"37d6e4a832a95d0832e73bc11560d7b972ff267e13df425e64e9cdcb08ddd058"} Jul 22 15:19:00.716038 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:00.716008 2542 generic.go:356] "Generic (PLEG): container finished" podID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerID="fe0636d8e6f6041d3f74d9662371c22df0687d76098deed7201283855aa9176b" exitCode=0 Jul 22 15:19:00.716407 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:00.716050 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" event={"ID":"af67618e-3ddb-4ffb-8959-f6f218da5618","Type":"ContainerDied","Data":"fe0636d8e6f6041d3f74d9662371c22df0687d76098deed7201283855aa9176b"} Jul 22 15:19:01.848606 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.848584 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:19:01.867004 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.866979 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle\") pod \"af67618e-3ddb-4ffb-8959-f6f218da5618\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " Jul 22 15:19:01.867117 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.867023 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2gmw\" (UniqueName: \"kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw\") pod \"af67618e-3ddb-4ffb-8959-f6f218da5618\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " Jul 22 15:19:01.867117 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.867085 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util\") pod \"af67618e-3ddb-4ffb-8959-f6f218da5618\" (UID: \"af67618e-3ddb-4ffb-8959-f6f218da5618\") " Jul 22 15:19:01.868223 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.868193 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle" (OuterVolumeSpecName: "bundle") pod "af67618e-3ddb-4ffb-8959-f6f218da5618" (UID: "af67618e-3ddb-4ffb-8959-f6f218da5618"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:19:01.869467 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.869436 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw" (OuterVolumeSpecName: "kube-api-access-n2gmw") pod "af67618e-3ddb-4ffb-8959-f6f218da5618" (UID: "af67618e-3ddb-4ffb-8959-f6f218da5618"). InnerVolumeSpecName "kube-api-access-n2gmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:19:01.874207 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.874179 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util" (OuterVolumeSpecName: "util") pod "af67618e-3ddb-4ffb-8959-f6f218da5618" (UID: "af67618e-3ddb-4ffb-8959-f6f218da5618"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:19:01.968521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.968491 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:19:01.968521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.968517 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af67618e-3ddb-4ffb-8959-f6f218da5618-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:19:01.968699 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:01.968530 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2gmw\" (UniqueName: \"kubernetes.io/projected/af67618e-3ddb-4ffb-8959-f6f218da5618-kube-api-access-n2gmw\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:19:02.726005 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:02.725981 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" Jul 22 15:19:02.726138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:02.725980 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2wsj" event={"ID":"af67618e-3ddb-4ffb-8959-f6f218da5618","Type":"ContainerDied","Data":"bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515"} Jul 22 15:19:02.726138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:02.726099 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbfa6abef5fcb7c36a04973c7ea77084ef57202580fc69775c1090524fe69515" Jul 22 15:19:09.689080 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:09.689047 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:09.788212 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:09.788186 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:10.349864 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.349825 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:10.729003 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.728924 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:10.829999 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.829975 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:10.859870 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.859845 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9"] Jul 22 15:19:10.860115 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860104 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="extract" Jul 22 15:19:10.860159 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860116 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="extract" Jul 22 15:19:10.860159 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860150 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="pull" Jul 22 15:19:10.860159 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860156 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="pull" Jul 22 15:19:10.860246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860164 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="util" Jul 22 15:19:10.860246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860170 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="util" Jul 22 15:19:10.860246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.860227 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="af67618e-3ddb-4ffb-8959-f6f218da5618" containerName="extract" Jul 22 15:19:10.862173 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.862160 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:10.864625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.864592 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 15:19:10.864758 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.864674 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 15:19:10.864758 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.864682 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 15:19:10.864758 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.864698 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 15:19:10.865025 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.865011 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9pwxz\"" Jul 22 15:19:10.879344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.879324 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9"] Jul 22 15:19:10.934826 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.934800 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:10.934943 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.934831 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlvd\" (UniqueName: \"kubernetes.io/projected/e765079b-f902-46d2-a888-ae7df6f66a24-kube-api-access-fzlvd\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:10.934943 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.934857 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:10.934943 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.934873 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:10.935057 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:10.934950 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.027129 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.027057 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:11.036081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036059 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.036164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036102 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.036164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036123 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlvd\" (UniqueName: \"kubernetes.io/projected/e765079b-f902-46d2-a888-ae7df6f66a24-kube-api-access-fzlvd\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.036164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036146 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.036349 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036253 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.036452 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.036428 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.038723 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.038700 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e765079b-f902-46d2-a888-ae7df6f66a24-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.038888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.038869 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.038931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.038869 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e765079b-f902-46d2-a888-ae7df6f66a24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.044874 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.044854 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlvd\" (UniqueName: \"kubernetes.io/projected/e765079b-f902-46d2-a888-ae7df6f66a24-kube-api-access-fzlvd\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-86wv9\" (UID: \"e765079b-f902-46d2-a888-ae7df6f66a24\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.125615 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.125588 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:11.172346 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.172322 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:11.234123 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.234076 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:11.310366 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.310346 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9"] Jul 22 15:19:11.312656 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:19:11.312616 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode765079b_f902_46d2_a888_ae7df6f66a24.slice/crio-73583d80ffe2588b54075762ecbb69bc7c9b7bfd5f6b3604d186b2b0018b0949 WatchSource:0}: Error finding container 73583d80ffe2588b54075762ecbb69bc7c9b7bfd5f6b3604d186b2b0018b0949: Status 404 returned error can't find the container with id 73583d80ffe2588b54075762ecbb69bc7c9b7bfd5f6b3604d186b2b0018b0949 Jul 22 15:19:11.314929 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.314883 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:11.433242 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.433190 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:11.766820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:11.766786 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" event={"ID":"e765079b-f902-46d2-a888-ae7df6f66a24","Type":"ContainerStarted","Data":"73583d80ffe2588b54075762ecbb69bc7c9b7bfd5f6b3604d186b2b0018b0949"} Jul 22 15:19:15.788091 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:15.788052 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" event={"ID":"e765079b-f902-46d2-a888-ae7df6f66a24","Type":"ContainerStarted","Data":"b85a46519dbd5700aed0dafcd368eda9343802c382645af74416494e3c213dfb"} Jul 22 15:19:15.985719 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:15.985686 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:16.734248 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:16.734214 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:16.793797 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:16.793768 2542 generic.go:356] "Generic (PLEG): container finished" podID="e765079b-f902-46d2-a888-ae7df6f66a24" containerID="b85a46519dbd5700aed0dafcd368eda9343802c382645af74416494e3c213dfb" exitCode=0 Jul 22 15:19:16.793797 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:16.793800 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" event={"ID":"e765079b-f902-46d2-a888-ae7df6f66a24","Type":"ContainerDied","Data":"b85a46519dbd5700aed0dafcd368eda9343802c382645af74416494e3c213dfb"} Jul 22 15:19:18.806981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:18.806941 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" event={"ID":"e765079b-f902-46d2-a888-ae7df6f66a24","Type":"ContainerStarted","Data":"2481506308b1e98c2e9a7a515e78c83ce01a76e0d319074c4d098efd64483d9d"} Jul 22 15:19:18.807397 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:18.807066 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:18.829437 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:18.829387 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" podStartSLOduration=3.282192357 podStartE2EDuration="8.829372981s" totalImagesPullingTime="4.512117764s" totalInitContainerRuntime="1.03506286s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:18.828215027 +0000 UTC m=+389.188297276" watchObservedRunningTime="2026-07-22 15:19:18.829372981 +0000 UTC m=+389.189455231" Jul 22 15:19:28.335196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.335168 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr"] Jul 22 15:19:28.344423 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.344394 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.347998 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.347832 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 15:19:28.347998 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.347952 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 15:19:28.348718 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.348422 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8zgdh\"" Jul 22 15:19:28.349431 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.348868 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 15:19:28.351758 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.351737 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr"] Jul 22 15:19:28.459368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.459324 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.459500 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.459393 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-metrics-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.459500 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.459413 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1340cd17-5d70-4fcc-be3d-152fd5f1436d-manager-config\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.459500 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.459437 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tsr\" (UniqueName: \"kubernetes.io/projected/1340cd17-5d70-4fcc-be3d-152fd5f1436d-kube-api-access-x5tsr\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.560586 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.560558 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-metrics-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.560725 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.560593 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1340cd17-5d70-4fcc-be3d-152fd5f1436d-manager-config\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.560725 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.560629 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tsr\" (UniqueName: \"kubernetes.io/projected/1340cd17-5d70-4fcc-be3d-152fd5f1436d-kube-api-access-x5tsr\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.560725 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.560697 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.561264 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.561244 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1340cd17-5d70-4fcc-be3d-152fd5f1436d-manager-config\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.563232 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.563210 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.563306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.563270 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1340cd17-5d70-4fcc-be3d-152fd5f1436d-metrics-cert\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.568735 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.568715 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tsr\" (UniqueName: \"kubernetes.io/projected/1340cd17-5d70-4fcc-be3d-152fd5f1436d-kube-api-access-x5tsr\") pod \"lws-controller-manager-947d9d946-xxxmr\" (UID: \"1340cd17-5d70-4fcc-be3d-152fd5f1436d\") " pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.656141 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.656090 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:28.784660 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.784621 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr"] Jul 22 15:19:28.786909 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:19:28.786886 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1340cd17_5d70_4fcc_be3d_152fd5f1436d.slice/crio-294c42bb49541b41edba9f197a41cf6a2e34a49b414da7a7cc8781b73f8f1fc6 WatchSource:0}: Error finding container 294c42bb49541b41edba9f197a41cf6a2e34a49b414da7a7cc8781b73f8f1fc6: Status 404 returned error can't find the container with id 294c42bb49541b41edba9f197a41cf6a2e34a49b414da7a7cc8781b73f8f1fc6 Jul 22 15:19:28.852566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:28.852535 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" event={"ID":"1340cd17-5d70-4fcc-be3d-152fd5f1436d","Type":"ContainerStarted","Data":"294c42bb49541b41edba9f197a41cf6a2e34a49b414da7a7cc8781b73f8f1fc6"} Jul 22 15:19:29.814326 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:29.814249 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-86wv9" Jul 22 15:19:30.864836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:30.864798 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" event={"ID":"1340cd17-5d70-4fcc-be3d-152fd5f1436d","Type":"ContainerStarted","Data":"5dbe50a84774f8993ccc203eedfb8bfde2d9ad041b5c46a40d7a434867d014cc"} Jul 22 15:19:30.865291 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:30.864924 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:30.895509 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:30.895464 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" podStartSLOduration=1.247192469 podStartE2EDuration="2.895449772s" totalImagesPullingTime="1.648257303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:30.893875091 +0000 UTC m=+401.253957324" watchObservedRunningTime="2026-07-22 15:19:30.895449772 +0000 UTC m=+401.255532021" Jul 22 15:19:31.489038 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:31.489001 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:31.600747 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:31.600717 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.137942 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.137912 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.471517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.471434 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.534275 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.534245 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.640587 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.640560 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.735364 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.735295 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:32.922403 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:32.922368 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:33.389335 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:33.389305 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:33.610459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:33.610430 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:33.674478 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:33.674400 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:34.622566 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:34.622527 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:34.722108 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:34.722078 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:39.809132 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.809091 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc"] Jul 22 15:19:39.813660 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.813619 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.816461 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.816439 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 15:19:39.816601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.816579 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 15:19:39.816729 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.816590 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 15:19:39.816729 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.816599 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 15:19:39.817586 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.817566 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zdb2q\"" Jul 22 15:19:39.826464 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.826444 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc"] Jul 22 15:19:39.944659 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944610 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49de927e-93ec-45fb-b75b-4115a8874b3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944668 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944717 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944761 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944821 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944792 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvph\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-kube-api-access-klvph\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944956 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944892 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:39.944989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:39.944961 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045504 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045469 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045517 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045543 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49de927e-93ec-45fb-b75b-4115a8874b3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045571 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045587 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045605 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.045692 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.045658 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvph\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-kube-api-access-klvph\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.046507 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.046479 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.048114 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.048083 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.048232 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.048131 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/49de927e-93ec-45fb-b75b-4115a8874b3c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.048232 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.048172 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.048232 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.048182 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.061389 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.061334 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvph\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-kube-api-access-klvph\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.061494 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.061472 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49de927e-93ec-45fb-b75b-4115a8874b3c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4zhc\" (UID: \"49de927e-93ec-45fb-b75b-4115a8874b3c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.123715 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.123691 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:40.282764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.282738 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc"] Jul 22 15:19:40.285577 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:19:40.285556 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49de927e_93ec_45fb_b75b_4115a8874b3c.slice/crio-80566f19a3e29ed2e78b63df3f7d0c7583676d544d69917006cdb92e174e0037 WatchSource:0}: Error finding container 80566f19a3e29ed2e78b63df3f7d0c7583676d544d69917006cdb92e174e0037: Status 404 returned error can't find the container with id 80566f19a3e29ed2e78b63df3f7d0c7583676d544d69917006cdb92e174e0037 Jul 22 15:19:40.909360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:40.909328 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" event={"ID":"49de927e-93ec-45fb-b75b-4115a8874b3c","Type":"ContainerStarted","Data":"80566f19a3e29ed2e78b63df3f7d0c7583676d544d69917006cdb92e174e0037"} Jul 22 15:19:41.872111 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:41.872076 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-947d9d946-xxxmr" Jul 22 15:19:42.562523 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:42.562488 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:42.634611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:42.634571 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:42.705069 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:42.705036 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:43.067647 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.067592 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:43.145452 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.145420 2542 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 15:19:43.145567 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.145483 2542 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 22 15:19:43.739984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.739946 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:43.840356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.840326 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:43.927455 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.927419 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" event={"ID":"49de927e-93ec-45fb-b75b-4115a8874b3c","Type":"ContainerStarted","Data":"5546b00213e9afc0f9c86114055604d639e921e6f2218bb0a72c0afb17bbb94c"} Jul 22 15:19:43.927623 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.927520 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:19:43.969691 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.969628 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" podStartSLOduration=2.111876707 podStartE2EDuration="4.969612895s" totalImagesPullingTime="2.857736188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:43.966556137 +0000 UTC m=+414.326638385" watchObservedRunningTime="2026-07-22 15:19:43.969612895 +0000 UTC m=+414.329695144" Jul 22 15:19:43.994812 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:43.994732 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:44.218798 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:44.218763 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:44.323057 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:44.322966 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:44.933517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:44.933488 2542 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-q4zhc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 15:19:44.933926 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:44.933534 2542 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" podUID="49de927e-93ec-45fb-b75b-4115a8874b3c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 15:19:45.126938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:45.126898 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:45.273013 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:45.272932 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:45.367004 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:45.366970 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:19:47.933518 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:19:47.933471 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4zhc" Jul 22 15:20:24.422122 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:24.422033 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:24.476021 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:24.475992 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:32.948088 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:32.948047 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:33.042350 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:33.042310 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:33.130350 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:33.130321 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:33.881080 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:33.881049 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:34.097214 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:34.097186 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:50.480764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.480731 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k"] Jul 22 15:20:50.484248 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.484232 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.486604 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.486579 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 15:20:50.486763 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.486655 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z9zk\"" Jul 22 15:20:50.487366 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.487351 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 15:20:50.490408 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.490386 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k"] Jul 22 15:20:50.553907 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.553880 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.553999 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.553930 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dtzp\" (UniqueName: \"kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.554040 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.554000 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.654846 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.654821 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.654940 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.654871 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.654984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.654936 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dtzp\" (UniqueName: \"kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.655245 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.655227 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.655281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.655263 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.663906 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.663887 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dtzp\" (UniqueName: \"kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.794172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.794117 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:50.881337 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.881304 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr"] Jul 22 15:20:50.885759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.885738 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:50.890794 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.890774 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr"] Jul 22 15:20:50.928036 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.928018 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k"] Jul 22 15:20:50.930405 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:20:50.930383 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66089b3d_f354_4ac1_a3d7_ce7ec26f4172.slice/crio-74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42 WatchSource:0}: Error finding container 74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42: Status 404 returned error can't find the container with id 74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42 Jul 22 15:20:50.957860 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.957837 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:50.957952 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.957892 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:50.957989 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:50.957943 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5d6\" (UniqueName: \"kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.059261 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.059214 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.059360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.059265 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.059360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.059317 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5d6\" (UniqueName: \"kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.059693 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.059672 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.059693 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.059683 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.068215 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.068196 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5d6\" (UniqueName: \"kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.197764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.197740 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:51.226640 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.226614 2542 generic.go:356] "Generic (PLEG): container finished" podID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerID="5a7a02cc8ed72d3cba6c5800ec159b86cf5e7f4eddc36dd13e1eb176ca22e09e" exitCode=0 Jul 22 15:20:51.226746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.226696 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" event={"ID":"66089b3d-f354-4ac1-a3d7-ce7ec26f4172","Type":"ContainerDied","Data":"5a7a02cc8ed72d3cba6c5800ec159b86cf5e7f4eddc36dd13e1eb176ca22e09e"} Jul 22 15:20:51.226746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.226744 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" event={"ID":"66089b3d-f354-4ac1-a3d7-ce7ec26f4172","Type":"ContainerStarted","Data":"74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42"} Jul 22 15:20:51.289981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.289956 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv"] Jul 22 15:20:51.293676 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.293652 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.302490 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.302463 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv"] Jul 22 15:20:51.332847 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.332825 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr"] Jul 22 15:20:51.334408 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:20:51.334382 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb20ff2_3f9c_432e_8da1_e120774c3052.slice/crio-95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae WatchSource:0}: Error finding container 95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae: Status 404 returned error can't find the container with id 95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae Jul 22 15:20:51.362413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.362391 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.362496 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.362420 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shc2g\" (UniqueName: \"kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.362538 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.362515 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.463359 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.463326 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.463493 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.463384 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.463493 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.463410 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shc2g\" (UniqueName: \"kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.463733 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.463711 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.463733 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.463723 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.475321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.475301 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shc2g\" (UniqueName: \"kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.607140 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.607090 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:51.690125 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.689880 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq"] Jul 22 15:20:51.694195 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.694174 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.702405 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.702378 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq"] Jul 22 15:20:51.746120 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.746100 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv"] Jul 22 15:20:51.747898 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:20:51.747876 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c83417f_9f31_4c07_8ada_f328548dac6d.slice/crio-189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4 WatchSource:0}: Error finding container 189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4: Status 404 returned error can't find the container with id 189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4 Jul 22 15:20:51.765753 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.765732 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.765841 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.765798 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6zm5\" (UniqueName: \"kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.765888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.765852 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.866868 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.866807 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6zm5\" (UniqueName: \"kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.866868 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.866861 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.867026 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.866887 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.867204 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.867189 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.867261 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.867220 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:51.876601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:51.876577 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6zm5\" (UniqueName: \"kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:52.006984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.006954 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:52.135943 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.135901 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq"] Jul 22 15:20:52.138351 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:20:52.138329 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b013168_8930_49c0_990c_d6a17bddbbeb.slice/crio-990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701 WatchSource:0}: Error finding container 990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701: Status 404 returned error can't find the container with id 990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701 Jul 22 15:20:52.232901 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.232872 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerStarted","Data":"0ed3c16732e3eb6fc32dfa6a64a7a710f347d2ee505b38a35892b494a23aee23"} Jul 22 15:20:52.233015 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.232935 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerStarted","Data":"990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701"} Jul 22 15:20:52.234235 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.234213 2542 generic.go:356] "Generic (PLEG): container finished" podID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerID="067e9cf6919b3965395f21af532746b22baffffd7a7700f0c03fc47b9f30f5f8" exitCode=0 Jul 22 15:20:52.234329 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.234294 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" event={"ID":"3c83417f-9f31-4c07-8ada-f328548dac6d","Type":"ContainerDied","Data":"067e9cf6919b3965395f21af532746b22baffffd7a7700f0c03fc47b9f30f5f8"} Jul 22 15:20:52.234398 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.234347 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" event={"ID":"3c83417f-9f31-4c07-8ada-f328548dac6d","Type":"ContainerStarted","Data":"189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4"} Jul 22 15:20:52.235799 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.235777 2542 generic.go:356] "Generic (PLEG): container finished" podID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerID="0403bb1127c88be530bef6e7879533076b99e44e25dbdfb634d5a39d4588123d" exitCode=0 Jul 22 15:20:52.235921 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.235818 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" event={"ID":"bdb20ff2-3f9c-432e-8da1-e120774c3052","Type":"ContainerDied","Data":"0403bb1127c88be530bef6e7879533076b99e44e25dbdfb634d5a39d4588123d"} Jul 22 15:20:52.235921 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:52.235850 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" event={"ID":"bdb20ff2-3f9c-432e-8da1-e120774c3052","Type":"ContainerStarted","Data":"95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae"} Jul 22 15:20:53.241671 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.241625 2542 generic.go:356] "Generic (PLEG): container finished" podID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerID="0ed3c16732e3eb6fc32dfa6a64a7a710f347d2ee505b38a35892b494a23aee23" exitCode=0 Jul 22 15:20:53.242052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.241666 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerDied","Data":"0ed3c16732e3eb6fc32dfa6a64a7a710f347d2ee505b38a35892b494a23aee23"} Jul 22 15:20:53.243676 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.243627 2542 generic.go:356] "Generic (PLEG): container finished" podID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerID="54dc28b3b38ae40f4352cc68bc46e127601467cc8bf13b860a2ea99e21a809ad" exitCode=0 Jul 22 15:20:53.243782 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.243734 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" event={"ID":"3c83417f-9f31-4c07-8ada-f328548dac6d","Type":"ContainerDied","Data":"54dc28b3b38ae40f4352cc68bc46e127601467cc8bf13b860a2ea99e21a809ad"} Jul 22 15:20:53.245849 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.245826 2542 generic.go:356] "Generic (PLEG): container finished" podID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerID="f37cb3aef04628e54bb277a5d12ddbe6f23b77e4e89ed6eaa5ff052e5223a582" exitCode=0 Jul 22 15:20:53.245970 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:53.245906 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" event={"ID":"bdb20ff2-3f9c-432e-8da1-e120774c3052","Type":"ContainerDied","Data":"f37cb3aef04628e54bb277a5d12ddbe6f23b77e4e89ed6eaa5ff052e5223a582"} Jul 22 15:20:54.253270 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.253210 2542 generic.go:356] "Generic (PLEG): container finished" podID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerID="ed26ee6625d9ed57aa7536a8af36057199b55b168a638bdab6fade28230465d7" exitCode=0 Jul 22 15:20:54.253629 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.253287 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" event={"ID":"66089b3d-f354-4ac1-a3d7-ce7ec26f4172","Type":"ContainerDied","Data":"ed26ee6625d9ed57aa7536a8af36057199b55b168a638bdab6fade28230465d7"} Jul 22 15:20:54.255486 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.255433 2542 generic.go:356] "Generic (PLEG): container finished" podID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerID="5bde60ce4a9e7436113710d0229201b47f85f6d6a4c5369f2693cff0fd853c06" exitCode=0 Jul 22 15:20:54.255599 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.255517 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerDied","Data":"5bde60ce4a9e7436113710d0229201b47f85f6d6a4c5369f2693cff0fd853c06"} Jul 22 15:20:54.257898 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.257878 2542 generic.go:356] "Generic (PLEG): container finished" podID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerID="fc5f87c510659f8653858e53ea40b80bc1bbc4af444ab5f4fcf7f8744e05ed17" exitCode=0 Jul 22 15:20:54.258002 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.257944 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" event={"ID":"3c83417f-9f31-4c07-8ada-f328548dac6d","Type":"ContainerDied","Data":"fc5f87c510659f8653858e53ea40b80bc1bbc4af444ab5f4fcf7f8744e05ed17"} Jul 22 15:20:54.260233 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.260213 2542 generic.go:356] "Generic (PLEG): container finished" podID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerID="33be082b412191e5e105e3e42b76622b35ae8e3e89e2b6fd18305ceda2955530" exitCode=0 Jul 22 15:20:54.260314 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:54.260251 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" event={"ID":"bdb20ff2-3f9c-432e-8da1-e120774c3052","Type":"ContainerDied","Data":"33be082b412191e5e105e3e42b76622b35ae8e3e89e2b6fd18305ceda2955530"} Jul 22 15:20:55.276524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.276490 2542 generic.go:356] "Generic (PLEG): container finished" podID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerID="6d2156873abf10069f1d8b8de7b2541585ddf91be765475f80d12429e630056e" exitCode=0 Jul 22 15:20:55.277049 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.276578 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" event={"ID":"66089b3d-f354-4ac1-a3d7-ce7ec26f4172","Type":"ContainerDied","Data":"6d2156873abf10069f1d8b8de7b2541585ddf91be765475f80d12429e630056e"} Jul 22 15:20:55.278679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.278656 2542 generic.go:356] "Generic (PLEG): container finished" podID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerID="5232a85defd22e15805b304fe28bd53b418bf343809c8e4b858feddfeb12acb2" exitCode=0 Jul 22 15:20:55.278800 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.278717 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerDied","Data":"5232a85defd22e15805b304fe28bd53b418bf343809c8e4b858feddfeb12acb2"} Jul 22 15:20:55.433871 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.433853 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:55.436601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.436584 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:55.499143 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499121 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle\") pod \"3c83417f-9f31-4c07-8ada-f328548dac6d\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " Jul 22 15:20:55.499301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499164 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util\") pod \"bdb20ff2-3f9c-432e-8da1-e120774c3052\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " Jul 22 15:20:55.499301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499189 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util\") pod \"3c83417f-9f31-4c07-8ada-f328548dac6d\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " Jul 22 15:20:55.499301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499229 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle\") pod \"bdb20ff2-3f9c-432e-8da1-e120774c3052\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " Jul 22 15:20:55.499301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499270 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq5d6\" (UniqueName: \"kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6\") pod \"bdb20ff2-3f9c-432e-8da1-e120774c3052\" (UID: \"bdb20ff2-3f9c-432e-8da1-e120774c3052\") " Jul 22 15:20:55.499301 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499293 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shc2g\" (UniqueName: \"kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g\") pod \"3c83417f-9f31-4c07-8ada-f328548dac6d\" (UID: \"3c83417f-9f31-4c07-8ada-f328548dac6d\") " Jul 22 15:20:55.499732 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499700 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle" (OuterVolumeSpecName: "bundle") pod "3c83417f-9f31-4c07-8ada-f328548dac6d" (UID: "3c83417f-9f31-4c07-8ada-f328548dac6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:55.499851 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.499770 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle" (OuterVolumeSpecName: "bundle") pod "bdb20ff2-3f9c-432e-8da1-e120774c3052" (UID: "bdb20ff2-3f9c-432e-8da1-e120774c3052"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:55.502221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.502196 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6" (OuterVolumeSpecName: "kube-api-access-jq5d6") pod "bdb20ff2-3f9c-432e-8da1-e120774c3052" (UID: "bdb20ff2-3f9c-432e-8da1-e120774c3052"). InnerVolumeSpecName "kube-api-access-jq5d6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:20:55.502221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.502203 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g" (OuterVolumeSpecName: "kube-api-access-shc2g") pod "3c83417f-9f31-4c07-8ada-f328548dac6d" (UID: "3c83417f-9f31-4c07-8ada-f328548dac6d"). InnerVolumeSpecName "kube-api-access-shc2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:20:55.504801 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.504768 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util" (OuterVolumeSpecName: "util") pod "3c83417f-9f31-4c07-8ada-f328548dac6d" (UID: "3c83417f-9f31-4c07-8ada-f328548dac6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:55.507079 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.507057 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util" (OuterVolumeSpecName: "util") pod "bdb20ff2-3f9c-432e-8da1-e120774c3052" (UID: "bdb20ff2-3f9c-432e-8da1-e120774c3052"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:55.600164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600141 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:55.600164 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600163 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:55.600288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600171 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdb20ff2-3f9c-432e-8da1-e120774c3052-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:55.600288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600179 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq5d6\" (UniqueName: \"kubernetes.io/projected/bdb20ff2-3f9c-432e-8da1-e120774c3052-kube-api-access-jq5d6\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:55.600288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600189 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shc2g\" (UniqueName: \"kubernetes.io/projected/3c83417f-9f31-4c07-8ada-f328548dac6d-kube-api-access-shc2g\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:55.600288 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:55.600198 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c83417f-9f31-4c07-8ada-f328548dac6d-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.285953 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.285932 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" Jul 22 15:20:56.286331 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.285926 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv" event={"ID":"3c83417f-9f31-4c07-8ada-f328548dac6d","Type":"ContainerDied","Data":"189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4"} Jul 22 15:20:56.286331 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.286046 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="189b1daf2d118d59f6c8a9be527a6f876f5e82af22082770dbad438d66e58ec4" Jul 22 15:20:56.288169 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.288123 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" Jul 22 15:20:56.288169 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.288159 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr" event={"ID":"bdb20ff2-3f9c-432e-8da1-e120774c3052","Type":"ContainerDied","Data":"95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae"} Jul 22 15:20:56.288347 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.288198 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a61c18ea517a2b60dd17f126e524e87d9d528cba5844d74e47b2415cf074ae" Jul 22 15:20:56.414126 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.414098 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:56.433827 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.433796 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:56.505942 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.505910 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle\") pod \"0b013168-8930-49c0-990c-d6a17bddbbeb\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " Jul 22 15:20:56.505942 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.505947 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle\") pod \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " Jul 22 15:20:56.506145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.505986 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util\") pod \"0b013168-8930-49c0-990c-d6a17bddbbeb\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " Jul 22 15:20:56.506145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.506028 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dtzp\" (UniqueName: \"kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp\") pod \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " Jul 22 15:20:56.506145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.506048 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6zm5\" (UniqueName: \"kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5\") pod \"0b013168-8930-49c0-990c-d6a17bddbbeb\" (UID: \"0b013168-8930-49c0-990c-d6a17bddbbeb\") " Jul 22 15:20:56.506145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.506082 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util\") pod \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\" (UID: \"66089b3d-f354-4ac1-a3d7-ce7ec26f4172\") " Jul 22 15:20:56.506583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.506553 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle" (OuterVolumeSpecName: "bundle") pod "0b013168-8930-49c0-990c-d6a17bddbbeb" (UID: "0b013168-8930-49c0-990c-d6a17bddbbeb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:56.506901 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.506781 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle" (OuterVolumeSpecName: "bundle") pod "66089b3d-f354-4ac1-a3d7-ce7ec26f4172" (UID: "66089b3d-f354-4ac1-a3d7-ce7ec26f4172"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:56.508268 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.508246 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp" (OuterVolumeSpecName: "kube-api-access-4dtzp") pod "66089b3d-f354-4ac1-a3d7-ce7ec26f4172" (UID: "66089b3d-f354-4ac1-a3d7-ce7ec26f4172"). InnerVolumeSpecName "kube-api-access-4dtzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:20:56.508544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.508528 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5" (OuterVolumeSpecName: "kube-api-access-r6zm5") pod "0b013168-8930-49c0-990c-d6a17bddbbeb" (UID: "0b013168-8930-49c0-990c-d6a17bddbbeb"). InnerVolumeSpecName "kube-api-access-r6zm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:20:56.511145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.511125 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util" (OuterVolumeSpecName: "util") pod "66089b3d-f354-4ac1-a3d7-ce7ec26f4172" (UID: "66089b3d-f354-4ac1-a3d7-ce7ec26f4172"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:56.512378 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.512360 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util" (OuterVolumeSpecName: "util") pod "0b013168-8930-49c0-990c-d6a17bddbbeb" (UID: "0b013168-8930-49c0-990c-d6a17bddbbeb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 15:20:56.606984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.606962 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dtzp\" (UniqueName: \"kubernetes.io/projected/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-kube-api-access-4dtzp\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.606984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.606982 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6zm5\" (UniqueName: \"kubernetes.io/projected/0b013168-8930-49c0-990c-d6a17bddbbeb-kube-api-access-r6zm5\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.607097 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.606993 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.607097 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.607001 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.607097 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.607009 2542 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66089b3d-f354-4ac1-a3d7-ce7ec26f4172-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:56.607097 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:56.607016 2542 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b013168-8930-49c0-990c-d6a17bddbbeb-util\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:20:57.295532 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.295501 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" Jul 22 15:20:57.295984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.295492 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k" event={"ID":"66089b3d-f354-4ac1-a3d7-ce7ec26f4172","Type":"ContainerDied","Data":"74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42"} Jul 22 15:20:57.295984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.295653 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74132518015b4ff9ce87fdaac687298a52afc488eac1cffdd41f0d747b40db42" Jul 22 15:20:57.297603 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.297583 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" Jul 22 15:20:57.297746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.297603 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq" event={"ID":"0b013168-8930-49c0-990c-d6a17bddbbeb","Type":"ContainerDied","Data":"990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701"} Jul 22 15:20:57.297746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:57.297667 2542 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="990062742fef05250a90d839ee5259071901a0a3c614956cd32aa87f95891701" Jul 22 15:20:58.629904 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:58.629868 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:20:58.731997 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:20:58.731966 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:03.647051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:03.647006 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:07.864392 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:07.864347 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:09.462994 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:09.462964 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:21:09.575901 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:09.575863 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:09.822221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:09.822149 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:11.251481 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:11.251444 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:12.118266 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:12.118236 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:13.512473 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:13.512439 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:15.048083 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:15.048043 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:15.293013 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:15.292984 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:15.648077 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:15.648044 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:16.262526 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:16.262489 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:16.362544 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:16.362514 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:17.897174 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:17.897144 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:18.006890 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:18.006857 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:18.404368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:18.404336 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:18.481003 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:18.480973 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:20.057685 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:20.057632 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:20.154318 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:20.154279 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:22.066032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:22.065998 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:22.130469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:22.130431 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:23.510076 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:23.510036 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:23.858593 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:23.858549 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:26.150738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:26.150706 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:26.252592 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:26.252563 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:27.248820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:27.248776 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:27.349767 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:27.349740 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:34.483814 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.483748 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6976f8c878-qkvxd" podUID="f02a361e-aa4b-4240-a47e-f5665470709b" containerName="console" containerID="cri-o://8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f" gracePeriod=15 Jul 22 15:21:34.726054 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.726031 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:21:34.885896 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.885869 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.885901 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.885919 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.885934 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.885952 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886264 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886112 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hww5b\" (UniqueName: \"kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886264 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886239 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config\") pod \"f02a361e-aa4b-4240-a47e-f5665470709b\" (UID: \"f02a361e-aa4b-4240-a47e-f5665470709b\") " Jul 22 15:21:34.886405 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886356 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:21:34.886405 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886382 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca" (OuterVolumeSpecName: "service-ca") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:21:34.886521 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886499 2542 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.886573 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886545 2542 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-trusted-ca-bundle\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.886625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886498 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:21:34.886777 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.886677 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config" (OuterVolumeSpecName: "console-config") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:21:34.888308 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.888284 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:21:34.888413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.888305 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:21:34.888413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.888353 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b" (OuterVolumeSpecName: "kube-api-access-hww5b") pod "f02a361e-aa4b-4240-a47e-f5665470709b" (UID: "f02a361e-aa4b-4240-a47e-f5665470709b"). InnerVolumeSpecName "kube-api-access-hww5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:21:34.986982 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.986952 2542 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.986982 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.986976 2542 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-oauth-serving-cert\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.986982 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.986985 2542 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f02a361e-aa4b-4240-a47e-f5665470709b-console-oauth-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.987170 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.986994 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hww5b\" (UniqueName: \"kubernetes.io/projected/f02a361e-aa4b-4240-a47e-f5665470709b-kube-api-access-hww5b\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:34.987170 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:34.987003 2542 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f02a361e-aa4b-4240-a47e-f5665470709b-console-config\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:21:35.482469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.482433 2542 generic.go:356] "Generic (PLEG): container finished" podID="f02a361e-aa4b-4240-a47e-f5665470709b" containerID="8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f" exitCode=0 Jul 22 15:21:35.482469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.482473 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976f8c878-qkvxd" event={"ID":"f02a361e-aa4b-4240-a47e-f5665470709b","Type":"ContainerDied","Data":"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f"} Jul 22 15:21:35.482695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.482517 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6976f8c878-qkvxd" event={"ID":"f02a361e-aa4b-4240-a47e-f5665470709b","Type":"ContainerDied","Data":"48c9237f7f4dd1c136281b41ed991218f3d58af1160cd6a5f3d6fa6bc2cd496f"} Jul 22 15:21:35.482695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.482538 2542 scope.go:117] "RemoveContainer" containerID="8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f" Jul 22 15:21:35.482695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.482475 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6976f8c878-qkvxd" Jul 22 15:21:35.491826 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.491629 2542 scope.go:117] "RemoveContainer" containerID="8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f" Jul 22 15:21:35.492032 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:21:35.491881 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f\": container with ID starting with 8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f not found: ID does not exist" containerID="8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f" Jul 22 15:21:35.492032 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.491906 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f"} err="failed to get container status \"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f\": rpc error: code = NotFound desc = could not find container \"8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f\": container with ID starting with 8d8448f736a96f53b85b44007aeec41256fc84693f00888463126debc6008c5f not found: ID does not exist" Jul 22 15:21:35.526793 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.526768 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:21:35.534730 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.534710 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6976f8c878-qkvxd"] Jul 22 15:21:35.887206 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:35.887175 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:36.008531 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:36.008501 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:36.121911 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:36.121889 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02a361e-aa4b-4240-a47e-f5665470709b" path="/var/lib/kubelet/pods/f02a361e-aa4b-4240-a47e-f5665470709b/volumes" Jul 22 15:21:36.592981 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:36.592946 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:36.712862 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:36.712838 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:42.680746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:42.680661 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:42.780517 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:42.780477 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:45.849598 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:45.849560 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:45.952306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:45.952262 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:49.803705 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:49.803669 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:49.937524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:49.937492 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:58.632081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:58.632040 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:58.758774 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:58.758733 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:21:58.968537 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:21:58.968441 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:02.401305 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:02.401271 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:02.629181 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:02.629144 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:03.361946 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:03.361907 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:03.462223 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:03.462194 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:04.168120 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:04.168089 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:04.335804 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:04.335776 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:04.884487 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:04.884450 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:05.009654 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:05.009599 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:06.293986 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.293950 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:06.619103 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619075 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:22:06.619375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619364 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="util" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619377 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="util" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619388 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="pull" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619393 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="pull" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619400 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="extract" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619405 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="extract" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619413 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="pull" Jul 22 15:22:06.619421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619418 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="pull" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619425 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619431 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619442 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="pull" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619448 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="pull" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619455 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619460 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619466 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02a361e-aa4b-4240-a47e-f5665470709b" containerName="console" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619471 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02a361e-aa4b-4240-a47e-f5665470709b" containerName="console" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619479 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619483 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619490 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619495 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619501 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="pull" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619506 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="pull" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619511 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619516 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="util" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619521 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619525 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619572 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b013168-8930-49c0-990c-d6a17bddbbeb" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619580 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb20ff2-3f9c-432e-8da1-e120774c3052" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619587 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02a361e-aa4b-4240-a47e-f5665470709b" containerName="console" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619593 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="66089b3d-f354-4ac1-a3d7-ce7ec26f4172" containerName="extract" Jul 22 15:22:06.619624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.619598 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c83417f-9f31-4c07-8ada-f328548dac6d" containerName="extract" Jul 22 15:22:06.623869 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.623853 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.626182 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.626152 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z9zk\"" Jul 22 15:22:06.626182 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.626169 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 15:22:06.626355 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.626263 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 15:22:06.627035 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.627014 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 15:22:06.627377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.627355 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsc9j\" (UniqueName: \"kubernetes.io/projected/b8425659-878b-4909-8520-663c27932ca7-kube-api-access-dsc9j\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.627508 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.627413 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8425659-878b-4909-8520-663c27932ca7-config-file\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.631391 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.631370 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:22:06.653524 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.653505 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:22:06.727937 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.727911 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsc9j\" (UniqueName: \"kubernetes.io/projected/b8425659-878b-4909-8520-663c27932ca7-kube-api-access-dsc9j\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.728044 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.727959 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8425659-878b-4909-8520-663c27932ca7-config-file\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.728534 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.728515 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8425659-878b-4909-8520-663c27932ca7-config-file\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.736047 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.736020 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsc9j\" (UniqueName: \"kubernetes.io/projected/b8425659-878b-4909-8520-663c27932ca7-kube-api-access-dsc9j\") pod \"limitador-limitador-54d6d988d5-9cqkt\" (UID: \"b8425659-878b-4909-8520-663c27932ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:06.936487 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:06.936429 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:07.090462 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:07.090420 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:22:07.092718 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:22:07.092691 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8425659_878b_4909_8520_663c27932ca7.slice/crio-62c7928f072307d34b3b0f1927387dec536f8a6dc8e365f6ce4306eb445442b8 WatchSource:0}: Error finding container 62c7928f072307d34b3b0f1927387dec536f8a6dc8e365f6ce4306eb445442b8: Status 404 returned error can't find the container with id 62c7928f072307d34b3b0f1927387dec536f8a6dc8e365f6ce4306eb445442b8 Jul 22 15:22:07.642269 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:07.642227 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" event={"ID":"b8425659-878b-4909-8520-663c27932ca7","Type":"ContainerStarted","Data":"62c7928f072307d34b3b0f1927387dec536f8a6dc8e365f6ce4306eb445442b8"} Jul 22 15:22:09.655855 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:09.655824 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" event={"ID":"b8425659-878b-4909-8520-663c27932ca7","Type":"ContainerStarted","Data":"c7731e2e131d71dca2e2f263afde703c356cedd6b5bb8a1d04161c1aec8a4ea7"} Jul 22 15:22:09.656131 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:09.655950 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:09.674258 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:09.674217 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" podStartSLOduration=1.225987892 podStartE2EDuration="3.67420307s" totalImagesPullingTime="2.448215178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:09.672457855 +0000 UTC m=+560.032540105" watchObservedRunningTime="2026-07-22 15:22:09.67420307 +0000 UTC m=+560.034285358" Jul 22 15:22:16.209147 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:16.209113 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:20.662091 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:20.662062 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9cqkt" Jul 22 15:22:25.304807 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:25.304778 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:25.407290 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:25.407258 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:25.780027 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:25.779999 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:37.554844 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:37.554804 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:37.709857 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:37.709817 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:44.093967 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:44.093925 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:44.203090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:44.203054 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:44.305986 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:44.305959 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:47.441550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:47.441510 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:22:47.580588 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:22:47.580562 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:05.757018 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:05.756984 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:07.788287 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:07.788248 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:07.847793 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:07.847762 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:19.286162 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:19.286090 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:19.386572 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:19.386538 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:19.867574 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:19.867523 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:19.984173 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:19.984106 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:20.378895 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:20.378864 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:20.449732 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:20.449699 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:20.625836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:20.625803 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:23:27.239991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:27.239954 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:30.829861 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:30.829825 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:30.923842 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:30.923808 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:43.751599 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:43.751560 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:23:44.214618 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:23:44.214520 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:24:05.464079 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:05.464046 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:24:06.215756 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:06.215727 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:24:17.014365 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.014323 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4"] Jul 22 15:24:17.017603 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.017579 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.024498 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.024473 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 15:24:17.024658 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.024581 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 15:24:17.024658 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.024492 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xftm8\"" Jul 22 15:24:17.024658 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.024483 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 15:24:17.034763 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.034737 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4"] Jul 22 15:24:17.130441 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.130401 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:24:17.135452 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135430 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.135538 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135478 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.135583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135541 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.135583 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135563 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.135685 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135584 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.135685 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.135610 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbrn4\" (UniqueName: \"kubernetes.io/projected/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-kube-api-access-hbrn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.236950 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.236912 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.236968 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237018 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237035 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237053 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237376 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237078 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrn4\" (UniqueName: \"kubernetes.io/projected/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-kube-api-access-hbrn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237736 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237392 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237736 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237473 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.237736 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.237478 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.239609 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.239588 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.239704 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.239678 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.244916 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.244894 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbrn4\" (UniqueName: \"kubernetes.io/projected/9dc5086d-1e0b-44c2-99c3-ac6449865ce8-kube-api-access-hbrn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lqwc4\" (UID: \"9dc5086d-1e0b-44c2-99c3-ac6449865ce8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.327580 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.327489 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:17.458688 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.458662 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4"] Jul 22 15:24:17.460592 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:24:17.460566 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc5086d_1e0b_44c2_99c3_ac6449865ce8.slice/crio-efd92927cd505cf837a4f120bd94d9d72ee84b54b777db4f9178a4d8f7c4beac WatchSource:0}: Error finding container efd92927cd505cf837a4f120bd94d9d72ee84b54b777db4f9178a4d8f7c4beac: Status 404 returned error can't find the container with id efd92927cd505cf837a4f120bd94d9d72ee84b54b777db4f9178a4d8f7c4beac Jul 22 15:24:17.462269 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:17.462251 2542 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 15:24:18.125746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:18.125715 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:24:18.253780 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:18.253736 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" event={"ID":"9dc5086d-1e0b-44c2-99c3-ac6449865ce8","Type":"ContainerStarted","Data":"efd92927cd505cf837a4f120bd94d9d72ee84b54b777db4f9178a4d8f7c4beac"} Jul 22 15:24:19.260509 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:19.260474 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" event={"ID":"9dc5086d-1e0b-44c2-99c3-ac6449865ce8","Type":"ContainerStarted","Data":"87a8828d23654c25a6d0397cc21f2503f82ae4b4f369a7415b869f89e24e8db0"} Jul 22 15:24:19.278614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:19.278566 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" podStartSLOduration=2.170259724 podStartE2EDuration="3.278550113s" totalImagesPullingTime="1.108290389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:24:19.277230049 +0000 UTC m=+689.637312300" watchObservedRunningTime="2026-07-22 15:24:19.278550113 +0000 UTC m=+689.638632354" Jul 22 15:24:23.025013 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:23.024979 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:24:24.422678 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:24.422629 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:24:27.327801 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:27.327774 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:27.328207 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:27.327844 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:27.340721 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:27.340699 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:28.315486 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:28.315462 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lqwc4" Jul 22 15:24:39.917782 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:39.917743 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm"] Jul 22 15:24:39.923731 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:39.923705 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:39.926171 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:39.926146 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 15:24:39.930414 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:39.930384 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm"] Jul 22 15:24:40.005397 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005369 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.005397 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005401 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.005664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005432 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.005664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005510 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.005664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005536 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.005664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.005560 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76vch\" (UniqueName: \"kubernetes.io/projected/b806a2e1-a850-405e-8548-cbdeb1f3cf51-kube-api-access-76vch\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.021561 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.021536 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:24:40.106983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.106957 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.106989 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107012 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107101 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107309 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107151 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107309 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107177 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76vch\" (UniqueName: \"kubernetes.io/projected/b806a2e1-a850-405e-8548-cbdeb1f3cf51-kube-api-access-76vch\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107465 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107418 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107549 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107486 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.107549 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.107521 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.109520 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.109491 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b806a2e1-a850-405e-8548-cbdeb1f3cf51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.109724 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.109706 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b806a2e1-a850-405e-8548-cbdeb1f3cf51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.115368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.115345 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76vch\" (UniqueName: \"kubernetes.io/projected/b806a2e1-a850-405e-8548-cbdeb1f3cf51-kube-api-access-76vch\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qwdsm\" (UID: \"b806a2e1-a850-405e-8548-cbdeb1f3cf51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.235680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.235551 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:40.372937 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:40.372912 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm"] Jul 22 15:24:40.374624 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:24:40.374599 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb806a2e1_a850_405e_8548_cbdeb1f3cf51.slice/crio-6965f444ab276a3bbba64948c085ff04d106a976a4c5ba0b7f0648344dd7f179 WatchSource:0}: Error finding container 6965f444ab276a3bbba64948c085ff04d106a976a4c5ba0b7f0648344dd7f179: Status 404 returned error can't find the container with id 6965f444ab276a3bbba64948c085ff04d106a976a4c5ba0b7f0648344dd7f179 Jul 22 15:24:41.218872 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:41.218805 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:24:41.367931 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:41.367901 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" event={"ID":"b806a2e1-a850-405e-8548-cbdeb1f3cf51","Type":"ContainerStarted","Data":"1a82af427793ad26d1e452a0a97976559ffcd9838313ff6b9ded8e667555602f"} Jul 22 15:24:41.368084 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:41.367950 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" event={"ID":"b806a2e1-a850-405e-8548-cbdeb1f3cf51","Type":"ContainerStarted","Data":"6965f444ab276a3bbba64948c085ff04d106a976a4c5ba0b7f0648344dd7f179"} Jul 22 15:24:41.389283 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:41.389235 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" podStartSLOduration=2.16421362 podStartE2EDuration="2.389220254s" totalImagesPullingTime="225.006634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:24:41.388074783 +0000 UTC m=+711.748157035" watchObservedRunningTime="2026-07-22 15:24:41.389220254 +0000 UTC m=+711.749302503" Jul 22 15:24:50.236575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:50.236540 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:50.237053 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:50.236604 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:50.249694 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:50.249663 2542 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:50.419763 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:50.419739 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qwdsm" Jul 22 15:24:52.252791 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:52.252761 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:24:55.524814 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:24:55.524780 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:26:16.965782 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:16.965693 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:26:17.115719 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:17.115680 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:26:18.098099 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:18.098065 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:26:18.192268 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:18.192237 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:26:46.727292 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:46.727262 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:26:56.524248 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:26:56.524212 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:27:06.823324 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:27:06.823293 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:28:14.457705 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:14.457670 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:28:23.085432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:23.085387 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:28:24.351868 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:24.351829 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:28:50.126421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:50.126390 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:28:59.421746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:59.421713 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:28:59.987265 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:28:59.987233 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:00.095945 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:00.095911 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:00.204999 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:00.204971 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:07.303690 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:07.303631 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:07.461189 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:07.461158 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:07.566060 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:07.565994 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:07.703476 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:07.703448 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:13.650414 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:13.650326 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:13.720077 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:13.720037 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:30.926587 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:30.926552 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:29:32.422372 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:32.422323 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:40.228389 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:40.228348 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:29:42.539969 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:42.539931 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:29:50.112047 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:29:50.112019 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:30:00.228593 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:00.228565 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:30:10.320665 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:10.320619 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:30:18.796987 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:18.796953 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:30:22.016895 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:22.016865 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:30:32.511887 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:32.511854 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:30:42.417707 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:30:42.417618 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:31:07.619056 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:31:07.619024 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:31:19.715226 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:31:19.715192 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:31:43.024203 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:31:43.024170 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:31:55.539823 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:31:55.539777 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:32:01.729763 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:01.729727 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:32:12.230473 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:12.230395 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:32:24.521215 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:24.521184 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:32:25.014205 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:25.014173 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:32:34.320335 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:34.320300 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:32:43.920187 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:43.920156 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:32:53.410867 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:32:53.410827 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:34:41.815834 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:34:41.815791 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:34:53.421722 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:34:53.421690 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:02.624234 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:02.624200 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:16.219897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:16.219806 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:26.514972 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:26.514932 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:26.604394 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:26.604366 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:35:36.122655 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:36.122600 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:45.916088 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:45.916051 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:35:55.525724 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:35:55.525683 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:36:06.811607 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:36:06.811574 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:36:15.714622 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:36:15.714583 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:36:26.317310 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:36:26.317278 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:36:51.216763 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:36:51.216686 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:36:59.528236 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:36:59.528200 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:37:02.579007 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:02.578969 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:37:15.624356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:15.624317 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:37:26.337735 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:26.337693 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:37:28.334072 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:28.334041 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:37:43.528400 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:43.528359 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:37:47.424138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:47.424103 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:37:47.854009 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:47.853982 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:37:49.133280 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:37:49.133249 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:03.833438 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:03.833402 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:12.259350 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:12.259275 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:38:12.361200 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:12.361174 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:38:12.431897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:12.431871 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:23.972826 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:23.972781 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:38.545662 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:38.545617 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:47.649487 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:47.649453 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:38:57.627571 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:38:57.627538 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:39:05.632855 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:39:05.632821 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:39:15.725302 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:39:15.725264 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:39:28.733924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:39:28.733886 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:39:38.521161 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:39:38.521120 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:39:48.229211 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:39:48.229132 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:40:01.121504 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:40:01.121469 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:40:19.226604 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:40:19.226561 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:40:32.724757 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:40:32.724717 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:40:44.330145 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:40:44.330111 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:40:58.318280 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:40:58.318247 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:41:00.683957 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:00.683928 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:09.925256 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:09.925217 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:41:28.559666 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:28.559577 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:31.514140 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:31.514107 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:31.613431 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:31.613399 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:31.739227 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:31.739201 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:41:31.961297 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:31.961261 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:37.845410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:37.845374 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:38.137318 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:38.137216 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:38.239229 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:38.239209 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:38.433254 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:38.433159 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:38.620875 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:38.620841 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:41.186651 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:41.186602 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:41.283887 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:41.283859 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:41.425225 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:41.425197 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:41.893977 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:41.893946 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:41.994938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:41.994912 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:41:48.025112 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:41:48.025084 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:42:17.195156 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:17.195114 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:20.128897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:20.128862 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:42:21.825512 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:21.825478 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:22.095269 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:22.095237 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:22.207702 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:22.207667 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:22.480827 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:22.480749 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:22.581454 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:22.581421 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:22.756430 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:22.756353 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:23.627029 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:23.626978 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:23.687183 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:23.687154 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:25.018932 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.018897 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:25.478039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.478006 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:25.614959 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.614927 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:42:25.618166 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.618147 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.623135 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.623103 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e59bf8ff-serving-cert\"" Jul 22 15:42:25.623631 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.623606 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:42:25.623759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.623616 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:42:25.624568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.624032 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:42:25.628698 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.628624 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:42:25.705775 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.705721 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:25.706671 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.706628 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.706798 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.706711 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.706798 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.706788 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4sc\" (UniqueName: \"kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.808094 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.808019 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.808094 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.808057 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.808306 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.808109 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4sc\" (UniqueName: \"kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.808306 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:42:25.808171 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-serving-cert: secret "maas-api-e2e-migrate-e59bf8ff-serving-cert" not found Jul 22 15:42:25.808306 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:42:25.808253 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls podName:869f7f3d-e196-49b2-95a8-883f82aad792 nodeName:}" failed. No retries permitted until 2026-07-22 15:42:26.30823385 +0000 UTC m=+1776.668316077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls") pod "maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" (UID: "869f7f3d-e196-49b2-95a8-883f82aad792") : secret "maas-api-e2e-migrate-e59bf8ff-serving-cert" not found Jul 22 15:42:25.808815 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.808792 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:25.816667 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:25.816624 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4sc\" (UniqueName: \"kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:26.312860 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.312828 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:26.315431 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.315410 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") pod \"maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:26.535340 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.535309 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:26.624414 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.624362 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:26.671676 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.671654 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:42:26.673748 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:42:26.673718 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869f7f3d_e196_49b2_95a8_883f82aad792.slice/crio-ff065758b4552d4f1824ea8f8972bdd44f39042a250f3fe577e9fb74a5c6e19a WatchSource:0}: Error finding container ff065758b4552d4f1824ea8f8972bdd44f39042a250f3fe577e9fb74a5c6e19a: Status 404 returned error can't find the container with id ff065758b4552d4f1824ea8f8972bdd44f39042a250f3fe577e9fb74a5c6e19a Jul 22 15:42:26.675047 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.675028 2542 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 15:42:26.723419 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:26.723396 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:42:27.614497 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:27.614448 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" event={"ID":"869f7f3d-e196-49b2-95a8-883f82aad792","Type":"ContainerStarted","Data":"ff065758b4552d4f1824ea8f8972bdd44f39042a250f3fe577e9fb74a5c6e19a"} Jul 22 15:42:29.626883 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:29.626852 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" event={"ID":"869f7f3d-e196-49b2-95a8-883f82aad792","Type":"ContainerStarted","Data":"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6"} Jul 22 15:42:29.627355 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:29.626965 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:42:29.644483 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:29.644441 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" podStartSLOduration=2.283842224 podStartE2EDuration="4.644426801s" totalImagesPullingTime="2.360584577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:42:29.643093497 +0000 UTC m=+1780.003175745" watchObservedRunningTime="2026-07-22 15:42:29.644426801 +0000 UTC m=+1780.004509055" Jul 22 15:42:31.722864 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:31.722826 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:42:35.637429 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:42:35.637403 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:43:00.911113 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:00.911080 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:43:00.911539 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:00.911281 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" podUID="869f7f3d-e196-49b2-95a8-883f82aad792" containerName="maas-api" containerID="cri-o://eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6" gracePeriod=30 Jul 22 15:43:00.937816 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:00.937785 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:01.158980 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.158951 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:43:01.297274 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.297199 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") pod \"869f7f3d-e196-49b2-95a8-883f82aad792\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " Jul 22 15:43:01.297274 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.297232 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca\") pod \"869f7f3d-e196-49b2-95a8-883f82aad792\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " Jul 22 15:43:01.297473 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.297295 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt4sc\" (UniqueName: \"kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc\") pod \"869f7f3d-e196-49b2-95a8-883f82aad792\" (UID: \"869f7f3d-e196-49b2-95a8-883f82aad792\") " Jul 22 15:43:01.297605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.297579 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "869f7f3d-e196-49b2-95a8-883f82aad792" (UID: "869f7f3d-e196-49b2-95a8-883f82aad792"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:43:01.299664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.299621 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "869f7f3d-e196-49b2-95a8-883f82aad792" (UID: "869f7f3d-e196-49b2-95a8-883f82aad792"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:43:01.299777 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.299752 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc" (OuterVolumeSpecName: "kube-api-access-wt4sc") pod "869f7f3d-e196-49b2-95a8-883f82aad792" (UID: "869f7f3d-e196-49b2-95a8-883f82aad792"). InnerVolumeSpecName "kube-api-access-wt4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:43:01.397918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.397887 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869f7f3d-e196-49b2-95a8-883f82aad792-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:01.397918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.397916 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869f7f3d-e196-49b2-95a8-883f82aad792-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:01.397918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.397926 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt4sc\" (UniqueName: \"kubernetes.io/projected/869f7f3d-e196-49b2-95a8-883f82aad792-kube-api-access-wt4sc\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:01.789043 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.789016 2542 generic.go:356] "Generic (PLEG): container finished" podID="869f7f3d-e196-49b2-95a8-883f82aad792" containerID="eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6" exitCode=0 Jul 22 15:43:01.789198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.789072 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" Jul 22 15:43:01.789198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.789093 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" event={"ID":"869f7f3d-e196-49b2-95a8-883f82aad792","Type":"ContainerDied","Data":"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6"} Jul 22 15:43:01.789198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.789170 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7" event={"ID":"869f7f3d-e196-49b2-95a8-883f82aad792","Type":"ContainerDied","Data":"ff065758b4552d4f1824ea8f8972bdd44f39042a250f3fe577e9fb74a5c6e19a"} Jul 22 15:43:01.789198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.789198 2542 scope.go:117] "RemoveContainer" containerID="eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6" Jul 22 15:43:01.799893 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.799872 2542 scope.go:117] "RemoveContainer" containerID="eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6" Jul 22 15:43:01.800228 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:43:01.800199 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6\": container with ID starting with eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6 not found: ID does not exist" containerID="eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6" Jul 22 15:43:01.800326 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.800240 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6"} err="failed to get container status \"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6\": rpc error: code = NotFound desc = could not find container \"eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6\": container with ID starting with eaba8999638c3558e02ee2d96e971c322d997ad8e1d5dfeef77e9a0ad40069c6 not found: ID does not exist" Jul 22 15:43:01.818360 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.818328 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:43:01.823139 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:01.823119 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e59bf8ff-6ddf665d7c-kwpg7"] Jul 22 15:43:02.122008 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:02.121987 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869f7f3d-e196-49b2-95a8-883f82aad792" path="/var/lib/kubelet/pods/869f7f3d-e196-49b2-95a8-883f82aad792/volumes" Jul 22 15:43:03.621356 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:03.621316 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:43:05.626617 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:05.626585 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:05.713381 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:05.713352 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:06.710500 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:06.710436 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:06.762728 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:06.762673 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:06.831074 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:06.831050 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:08.597613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.597572 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:08.696653 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.696605 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:08.817499 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.817472 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:08.817926 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.817908 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869f7f3d-e196-49b2-95a8-883f82aad792" containerName="maas-api" Jul 22 15:43:08.817926 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.817928 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="869f7f3d-e196-49b2-95a8-883f82aad792" containerName="maas-api" Jul 22 15:43:08.818089 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.818011 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="869f7f3d-e196-49b2-95a8-883f82aad792" containerName="maas-api" Jul 22 15:43:08.822469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.822449 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:08.824688 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.824666 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:43:08.824971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.824946 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:43:08.825070 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.824981 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e6514ea7-serving-cert\"" Jul 22 15:43:08.825070 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.824986 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:43:08.832679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.832655 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:08.858497 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.858441 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:08.951614 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.951587 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:08.951740 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.951668 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9vx\" (UniqueName: \"kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:08.951740 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:08.951704 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.052755 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.052734 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.052882 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.052780 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9vx\" (UniqueName: \"kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.052882 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.052808 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.052987 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:43:09.052928 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-serving-cert: secret "maas-api-e2e-ait-e6514ea7-serving-cert" not found Jul 22 15:43:09.052987 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:43:09.052985 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls podName:a23d0264-4e1f-4638-b811-36354cb76111 nodeName:}" failed. No retries permitted until 2026-07-22 15:43:09.552965157 +0000 UTC m=+1819.913047389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls") pod "maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" (UID: "a23d0264-4e1f-4638-b811-36354cb76111") : secret "maas-api-e2e-ait-e6514ea7-serving-cert" not found Jul 22 15:43:09.053442 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.053424 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.063193 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.063164 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9vx\" (UniqueName: \"kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.241892 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.241826 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:09.341730 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.341700 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:09.441956 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.441928 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:09.556787 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.556723 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.559313 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.559295 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") pod \"maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.734513 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.734489 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:09.873375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:09.873354 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:09.875467 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:43:09.875441 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23d0264_4e1f_4638_b811_36354cb76111.slice/crio-a7e7092838396d01404cf3d9c05167086eeced23048a5abb125875200efea253 WatchSource:0}: Error finding container a7e7092838396d01404cf3d9c05167086eeced23048a5abb125875200efea253: Status 404 returned error can't find the container with id a7e7092838396d01404cf3d9c05167086eeced23048a5abb125875200efea253 Jul 22 15:43:10.842050 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:10.842011 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" event={"ID":"a23d0264-4e1f-4638-b811-36354cb76111","Type":"ContainerStarted","Data":"5da79bc4f684e63f3c0f4101ff1c5c0553b0d4d9fd4a58e48759adbee8b0bb02"} Jul 22 15:43:10.842404 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:10.842071 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" event={"ID":"a23d0264-4e1f-4638-b811-36354cb76111","Type":"ContainerStarted","Data":"a7e7092838396d01404cf3d9c05167086eeced23048a5abb125875200efea253"} Jul 22 15:43:10.842404 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:10.842109 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:10.860453 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:10.860405 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" podStartSLOduration=2.45135247 podStartE2EDuration="2.860388996s" totalImagesPullingTime="409.036526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:43:10.858614384 +0000 UTC m=+1821.218696636" watchObservedRunningTime="2026-07-22 15:43:10.860388996 +0000 UTC m=+1821.220471244" Jul 22 15:43:15.818321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:15.818285 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:43:16.854239 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:16.854203 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:44.824092 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:44.824061 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:44.826759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:44.824352 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" podUID="a23d0264-4e1f-4638-b811-36354cb76111" containerName="maas-api" containerID="cri-o://5da79bc4f684e63f3c0f4101ff1c5c0553b0d4d9fd4a58e48759adbee8b0bb02" gracePeriod=30 Jul 22 15:43:44.863122 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:44.863044 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:45.025382 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.025349 2542 generic.go:356] "Generic (PLEG): container finished" podID="a23d0264-4e1f-4638-b811-36354cb76111" containerID="5da79bc4f684e63f3c0f4101ff1c5c0553b0d4d9fd4a58e48759adbee8b0bb02" exitCode=0 Jul 22 15:43:45.025541 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.025426 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" event={"ID":"a23d0264-4e1f-4638-b811-36354cb76111","Type":"ContainerDied","Data":"5da79bc4f684e63f3c0f4101ff1c5c0553b0d4d9fd4a58e48759adbee8b0bb02"} Jul 22 15:43:45.071914 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.071894 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:45.102380 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.102356 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") pod \"a23d0264-4e1f-4638-b811-36354cb76111\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " Jul 22 15:43:45.102540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.102450 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr9vx\" (UniqueName: \"kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx\") pod \"a23d0264-4e1f-4638-b811-36354cb76111\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " Jul 22 15:43:45.102540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.102502 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca\") pod \"a23d0264-4e1f-4638-b811-36354cb76111\" (UID: \"a23d0264-4e1f-4638-b811-36354cb76111\") " Jul 22 15:43:45.102913 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.102885 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a23d0264-4e1f-4638-b811-36354cb76111" (UID: "a23d0264-4e1f-4638-b811-36354cb76111"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:43:45.104658 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.104615 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a23d0264-4e1f-4638-b811-36354cb76111" (UID: "a23d0264-4e1f-4638-b811-36354cb76111"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:43:45.104765 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.104745 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx" (OuterVolumeSpecName: "kube-api-access-nr9vx") pod "a23d0264-4e1f-4638-b811-36354cb76111" (UID: "a23d0264-4e1f-4638-b811-36354cb76111"). InnerVolumeSpecName "kube-api-access-nr9vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:43:45.203410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.203372 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23d0264-4e1f-4638-b811-36354cb76111-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:45.203410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.203404 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23d0264-4e1f-4638-b811-36354cb76111-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:45.203410 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:45.203414 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr9vx\" (UniqueName: \"kubernetes.io/projected/a23d0264-4e1f-4638-b811-36354cb76111-kube-api-access-nr9vx\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:43:46.031311 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.031283 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" Jul 22 15:43:46.031743 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.031325 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv" event={"ID":"a23d0264-4e1f-4638-b811-36354cb76111","Type":"ContainerDied","Data":"a7e7092838396d01404cf3d9c05167086eeced23048a5abb125875200efea253"} Jul 22 15:43:46.031743 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.031386 2542 scope.go:117] "RemoveContainer" containerID="5da79bc4f684e63f3c0f4101ff1c5c0553b0d4d9fd4a58e48759adbee8b0bb02" Jul 22 15:43:46.051922 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.051895 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:46.056283 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.056259 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6514ea7-9d8595f4f-gzvxv"] Jul 22 15:43:46.121975 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.121947 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a23d0264-4e1f-4638-b811-36354cb76111" path="/var/lib/kubelet/pods/a23d0264-4e1f-4638-b811-36354cb76111/volumes" Jul 22 15:43:46.810845 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:46.810811 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:47.733220 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:47.733183 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:43:48.082568 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:48.082533 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:49.477582 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:49.477548 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:50.678307 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:50.678268 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:50.896534 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:50.896490 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:51.121002 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:51.120967 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:51.472182 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:51.472112 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:52.052021 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:52.051993 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:53.929371 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.929341 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:53.938062 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.938035 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:43:53.938391 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.938379 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23d0264-4e1f-4638-b811-36354cb76111" containerName="maas-api" Jul 22 15:43:53.938436 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.938392 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23d0264-4e1f-4638-b811-36354cb76111" containerName="maas-api" Jul 22 15:43:53.938470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.938444 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23d0264-4e1f-4638-b811-36354cb76111" containerName="maas-api" Jul 22 15:43:53.941261 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.941243 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:53.943606 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.943589 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-37d7a1f9-serving-cert\"" Jul 22 15:43:53.943752 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.943629 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:43:53.944514 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.944495 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:43:53.944595 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.944524 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:43:53.952338 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.952315 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:43:53.970353 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.970333 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:53.970470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.970383 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq5kw\" (UniqueName: \"kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:53.970470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:53.970431 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.071988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.071958 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.072192 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.072173 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq5kw\" (UniqueName: \"kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.072321 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.072307 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.072506 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:43:54.072089 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-serving-cert: secret "maas-api-e2e-derive-37d7a1f9-serving-cert" not found Jul 22 15:43:54.072690 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:43:54.072678 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls podName:8708feb9-39c9-4166-a906-1e919e860316 nodeName:}" failed. No retries permitted until 2026-07-22 15:43:54.572626858 +0000 UTC m=+1864.932709090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls") pod "maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" (UID: "8708feb9-39c9-4166-a906-1e919e860316") : secret "maas-api-e2e-derive-37d7a1f9-serving-cert" not found Jul 22 15:43:54.073196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.073166 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.081660 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.081614 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq5kw\" (UniqueName: \"kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.576229 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.576195 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.578790 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.578759 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") pod \"maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.852935 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.852911 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:54.992295 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:54.992273 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:43:54.994419 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:43:54.994391 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8708feb9_39c9_4166_a906_1e919e860316.slice/crio-0d502e70fc433de544f6c01d7d14fd215bf105cee61d782c65c760763a84c172 WatchSource:0}: Error finding container 0d502e70fc433de544f6c01d7d14fd215bf105cee61d782c65c760763a84c172: Status 404 returned error can't find the container with id 0d502e70fc433de544f6c01d7d14fd215bf105cee61d782c65c760763a84c172 Jul 22 15:43:55.080087 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:55.080062 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" event={"ID":"8708feb9-39c9-4166-a906-1e919e860316","Type":"ContainerStarted","Data":"0d502e70fc433de544f6c01d7d14fd215bf105cee61d782c65c760763a84c172"} Jul 22 15:43:55.116631 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:55.116564 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:55.215144 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:55.215119 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:43:56.086117 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:56.086079 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" event={"ID":"8708feb9-39c9-4166-a906-1e919e860316","Type":"ContainerStarted","Data":"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc"} Jul 22 15:43:56.086523 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:56.086180 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:43:56.104923 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:56.104876 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" podStartSLOduration=2.615731881 podStartE2EDuration="3.104860613s" totalImagesPullingTime="489.128732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:43:56.102767064 +0000 UTC m=+1866.462849328" watchObservedRunningTime="2026-07-22 15:43:56.104860613 +0000 UTC m=+1866.464942862" Jul 22 15:43:59.020631 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:43:59.020596 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:44:02.097749 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:02.097719 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:44:29.303235 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.303155 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:44:29.303759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.303350 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" podUID="8708feb9-39c9-4166-a906-1e919e860316" containerName="maas-api" containerID="cri-o://a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc" gracePeriod=30 Jul 22 15:44:29.328764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.328716 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:29.549202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.549176 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:44:29.645087 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.645066 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq5kw\" (UniqueName: \"kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw\") pod \"8708feb9-39c9-4166-a906-1e919e860316\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " Jul 22 15:44:29.645251 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.645138 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") pod \"8708feb9-39c9-4166-a906-1e919e860316\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " Jul 22 15:44:29.645251 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.645171 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca\") pod \"8708feb9-39c9-4166-a906-1e919e860316\" (UID: \"8708feb9-39c9-4166-a906-1e919e860316\") " Jul 22 15:44:29.645529 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.645497 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8708feb9-39c9-4166-a906-1e919e860316" (UID: "8708feb9-39c9-4166-a906-1e919e860316"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:44:29.647273 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.647239 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw" (OuterVolumeSpecName: "kube-api-access-qq5kw") pod "8708feb9-39c9-4166-a906-1e919e860316" (UID: "8708feb9-39c9-4166-a906-1e919e860316"). InnerVolumeSpecName "kube-api-access-qq5kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:44:29.647362 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.647296 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8708feb9-39c9-4166-a906-1e919e860316" (UID: "8708feb9-39c9-4166-a906-1e919e860316"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:44:29.745958 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.745923 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8708feb9-39c9-4166-a906-1e919e860316-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:44:29.745958 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.745956 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8708feb9-39c9-4166-a906-1e919e860316-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:44:29.745958 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:29.745967 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq5kw\" (UniqueName: \"kubernetes.io/projected/8708feb9-39c9-4166-a906-1e919e860316-kube-api-access-qq5kw\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:44:30.255849 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.255818 2542 generic.go:356] "Generic (PLEG): container finished" podID="8708feb9-39c9-4166-a906-1e919e860316" containerID="a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc" exitCode=0 Jul 22 15:44:30.255988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.255862 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" Jul 22 15:44:30.255988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.255857 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" event={"ID":"8708feb9-39c9-4166-a906-1e919e860316","Type":"ContainerDied","Data":"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc"} Jul 22 15:44:30.255988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.255969 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4" event={"ID":"8708feb9-39c9-4166-a906-1e919e860316","Type":"ContainerDied","Data":"0d502e70fc433de544f6c01d7d14fd215bf105cee61d782c65c760763a84c172"} Jul 22 15:44:30.256115 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.255991 2542 scope.go:117] "RemoveContainer" containerID="a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc" Jul 22 15:44:30.264915 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.264900 2542 scope.go:117] "RemoveContainer" containerID="a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc" Jul 22 15:44:30.265171 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:44:30.265154 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc\": container with ID starting with a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc not found: ID does not exist" containerID="a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc" Jul 22 15:44:30.265221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.265178 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc"} err="failed to get container status \"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc\": rpc error: code = NotFound desc = could not find container \"a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc\": container with ID starting with a2727731354a8e4145a87e95b5375b386062d6457535a70284369b3c39d9abbc not found: ID does not exist" Jul 22 15:44:30.272904 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.272884 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:44:30.278809 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:30.278790 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-37d7a1f9-696669c49b-27cq4"] Jul 22 15:44:32.122238 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:32.122201 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8708feb9-39c9-4166-a906-1e919e860316" path="/var/lib/kubelet/pods/8708feb9-39c9-4166-a906-1e919e860316/volumes" Jul 22 15:44:32.424613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:32.424521 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:44:33.782506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:33.782460 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:33.956368 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:33.956328 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:34.188721 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:34.188691 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:34.713091 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:34.713063 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:34.816334 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:34.816302 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:34.914723 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:34.914696 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:36.303258 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:36.303223 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:42.269080 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:42.269038 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:42.381629 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:42.381587 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:42.579576 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:42.579503 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:42.676886 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:42.676856 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:44:43.038019 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:44:43.037991 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:09.062995 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:09.062948 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:15.598177 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:15.598139 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:15.706427 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:15.706393 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:15.816582 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:15.816544 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:31.784595 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:31.784557 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:37.505806 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:37.505772 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:37.578101 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:37.578043 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:37.722579 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:37.722551 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:48.185488 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:48.185402 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:48.285485 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:48.285453 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:48.395248 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:48.395220 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:49.141421 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:49.141379 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:56.051964 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:56.051928 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:56.234593 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:56.234561 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:56.471696 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:56.471662 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:56.646983 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:56.646948 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:57.326180 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:57.326149 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:57.430361 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:57.430332 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:45:59.042528 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:45:59.042496 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:00.832745 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:00.832711 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:46:04.883324 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:04.883289 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:06.440978 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:06.440949 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:11.238503 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:11.238476 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:11.317764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:11.317734 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:11.477021 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:11.476995 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:11.790843 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:11.790786 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:12.248338 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:12.248306 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:12.321845 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:12.321822 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:46:15.187152 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.187122 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:15.291071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.291038 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:15.386715 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.386687 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:15.617437 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.617400 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:15.861916 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.861895 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:15.962475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:15.962407 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:19.678993 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:19.678942 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:20.362905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:20.362859 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:20.464002 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:20.463950 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:20.785041 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:20.784961 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:21.925348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:21.925313 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:46:26.587780 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:26.587752 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:26.688334 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:26.688310 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:37.387906 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:37.387873 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:40.225459 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:40.225434 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:46:42.015974 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:42.015947 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:42.387982 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:42.387922 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:48.452677 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:48.452622 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:48.554553 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:48.554524 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:48.698659 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:48.698617 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:48.938604 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:48.938574 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:49.083944 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:49.083903 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:49.178045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:49.178022 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:49.304157 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:49.304091 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:55.275218 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:55.275185 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:55.381993 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:55.381957 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:55.476507 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:55.476453 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:46:55.622988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:46:55.622957 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:01.515346 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:01.515311 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:01.616135 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:01.616046 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:08.267303 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:08.267266 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:08.614453 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:08.614261 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:09.083793 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:09.083767 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:11.402996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.402879 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:11.503456 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.503425 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:47:11.503824 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.503811 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8708feb9-39c9-4166-a906-1e919e860316" containerName="maas-api" Jul 22 15:47:11.503872 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.503827 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="8708feb9-39c9-4166-a906-1e919e860316" containerName="maas-api" Jul 22 15:47:11.503907 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.503899 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="8708feb9-39c9-4166-a906-1e919e860316" containerName="maas-api" Jul 22 15:47:11.505464 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.505435 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:11.507069 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.507049 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.509452 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.509431 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b432cbd3-serving-cert\"" Jul 22 15:47:11.510593 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.510577 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:47:11.510697 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.510577 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:47:11.511436 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.511422 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:47:11.525328 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.525306 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:47:11.584858 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.584830 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.584980 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.584884 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrbwj\" (UniqueName: \"kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.584980 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.584921 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.619085 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.619058 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:11.685972 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.685915 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.685972 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.685948 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrbwj\" (UniqueName: \"kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.685972 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.685972 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.686189 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:47:11.686092 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-serving-cert: secret "maas-api-e2e-mt-b432cbd3-serving-cert" not found Jul 22 15:47:11.686189 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:47:11.686146 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls podName:5684cc05-c20a-4911-b249-557604cbac27 nodeName:}" failed. No retries permitted until 2026-07-22 15:47:12.186127876 +0000 UTC m=+2062.546210103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls") pod "maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" (UID: "5684cc05-c20a-4911-b249-557604cbac27") : secret "maas-api-e2e-mt-b432cbd3-serving-cert" not found Jul 22 15:47:11.686605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.686583 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:11.696868 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:11.696851 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrbwj\" (UniqueName: \"kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:12.189874 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.189844 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:12.192482 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.192456 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") pod \"maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:12.292386 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.292361 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:12.394094 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.394066 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:12.418905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.418884 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:12.557312 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:12.557290 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:47:12.559103 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:47:12.559078 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5684cc05_c20a_4911_b249_557604cbac27.slice/crio-75749057b0a2d3c94be6c2aa9a9cd136ed6b857f91c4c6d5a3a2b8118d614e4c WatchSource:0}: Error finding container 75749057b0a2d3c94be6c2aa9a9cd136ed6b857f91c4c6d5a3a2b8118d614e4c: Status 404 returned error can't find the container with id 75749057b0a2d3c94be6c2aa9a9cd136ed6b857f91c4c6d5a3a2b8118d614e4c Jul 22 15:47:13.076406 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:13.076384 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" event={"ID":"5684cc05-c20a-4911-b249-557604cbac27","Type":"ContainerStarted","Data":"75749057b0a2d3c94be6c2aa9a9cd136ed6b857f91c4c6d5a3a2b8118d614e4c"} Jul 22 15:47:13.638156 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:13.638118 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:13.703800 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:13.703770 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:14.082704 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:14.082672 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" event={"ID":"5684cc05-c20a-4911-b249-557604cbac27","Type":"ContainerStarted","Data":"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093"} Jul 22 15:47:14.082870 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:14.082735 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:14.101022 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:14.100966 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" podStartSLOduration=2.58699877 podStartE2EDuration="3.100945415s" totalImagesPullingTime="513.946645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:47:14.100335204 +0000 UTC m=+2064.460417453" watchObservedRunningTime="2026-07-22 15:47:14.100945415 +0000 UTC m=+2064.461027667" Jul 22 15:47:15.896377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:15.896334 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:18.626463 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:18.626431 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:47:20.094143 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:20.094113 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:47:21.560109 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:21.560072 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:23.844888 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:23.844850 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:30.434303 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:30.434268 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:47:40.288828 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:40.288791 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:47:42.425734 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:47:42.425700 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:48:03.126192 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:03.126151 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:48:04.773652 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:04.773595 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:48:04.774223 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:04.774181 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" podUID="5684cc05-c20a-4911-b249-557604cbac27" containerName="maas-api" containerID="cri-o://444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093" gracePeriod=30 Jul 22 15:48:04.813221 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:04.813191 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:05.023365 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.023346 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:48:05.115453 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.115432 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca\") pod \"5684cc05-c20a-4911-b249-557604cbac27\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " Jul 22 15:48:05.115571 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.115488 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrbwj\" (UniqueName: \"kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj\") pod \"5684cc05-c20a-4911-b249-557604cbac27\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " Jul 22 15:48:05.115613 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.115577 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") pod \"5684cc05-c20a-4911-b249-557604cbac27\" (UID: \"5684cc05-c20a-4911-b249-557604cbac27\") " Jul 22 15:48:05.115865 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.115837 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5684cc05-c20a-4911-b249-557604cbac27" (UID: "5684cc05-c20a-4911-b249-557604cbac27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:48:05.117671 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.117627 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj" (OuterVolumeSpecName: "kube-api-access-rrbwj") pod "5684cc05-c20a-4911-b249-557604cbac27" (UID: "5684cc05-c20a-4911-b249-557604cbac27"). InnerVolumeSpecName "kube-api-access-rrbwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:48:05.117753 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.117697 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5684cc05-c20a-4911-b249-557604cbac27" (UID: "5684cc05-c20a-4911-b249-557604cbac27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:48:05.216792 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.216769 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5684cc05-c20a-4911-b249-557604cbac27-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:48:05.216792 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.216788 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5684cc05-c20a-4911-b249-557604cbac27-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:48:05.216924 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.216797 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrbwj\" (UniqueName: \"kubernetes.io/projected/5684cc05-c20a-4911-b249-557604cbac27-kube-api-access-rrbwj\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:48:05.339241 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.339216 2542 generic.go:356] "Generic (PLEG): container finished" podID="5684cc05-c20a-4911-b249-557604cbac27" containerID="444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093" exitCode=0 Jul 22 15:48:05.339374 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.339282 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" Jul 22 15:48:05.339374 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.339285 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" event={"ID":"5684cc05-c20a-4911-b249-557604cbac27","Type":"ContainerDied","Data":"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093"} Jul 22 15:48:05.339484 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.339418 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw" event={"ID":"5684cc05-c20a-4911-b249-557604cbac27","Type":"ContainerDied","Data":"75749057b0a2d3c94be6c2aa9a9cd136ed6b857f91c4c6d5a3a2b8118d614e4c"} Jul 22 15:48:05.339484 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.339439 2542 scope.go:117] "RemoveContainer" containerID="444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093" Jul 22 15:48:05.348482 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.348465 2542 scope.go:117] "RemoveContainer" containerID="444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093" Jul 22 15:48:05.348763 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:48:05.348747 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093\": container with ID starting with 444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093 not found: ID does not exist" containerID="444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093" Jul 22 15:48:05.348810 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.348772 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093"} err="failed to get container status \"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093\": rpc error: code = NotFound desc = could not find container \"444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093\": container with ID starting with 444ccee0365764fc3723678392d993048d794197398ffb04f8fcfb6e8e276093 not found: ID does not exist" Jul 22 15:48:05.363503 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.363481 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:48:05.365551 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:05.365507 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b432cbd3-84554d5bc7-mnhqw"] Jul 22 15:48:06.122394 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:06.122360 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5684cc05-c20a-4911-b249-557604cbac27" path="/var/lib/kubelet/pods/5684cc05-c20a-4911-b249-557604cbac27/volumes" Jul 22 15:48:09.398775 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:09.398744 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:11.701390 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:11.701341 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:13.720795 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:13.720753 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:48:16.754441 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:16.754393 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:47.586625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:47.586586 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:47.687886 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:47.687855 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:53.095457 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:53.095415 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:54.039440 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:54.039396 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:59.720938 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:59.720886 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:48:59.817927 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:48:59.817896 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:00.006830 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:00.006741 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:00.228458 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:00.228416 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:01.365783 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:01.365742 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:01.460106 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:01.460078 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:01.560873 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:01.560844 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:02.378945 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:02.378895 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:02.464273 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:02.464244 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:02.564155 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:02.564126 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:03.930098 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:03.930065 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:49:03.974482 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:03.974448 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:10.003791 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:10.003754 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:10.068095 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:10.068067 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:10.691674 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:10.691647 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:16.125365 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:16.125333 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:49:16.682160 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:16.682126 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:16.791101 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:16.791069 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:16.885123 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:16.885090 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:27.459039 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:27.459000 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:27.747251 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:27.747161 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:48.733299 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:48.733261 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:55.305058 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:55.305020 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:55.404850 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:55.404820 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:55.662103 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:55.662071 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:55.984907 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:55.984832 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:56.751904 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:56.751868 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:59.178466 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.178436 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:59.277735 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.277706 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:59.358344 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.358315 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:49:59.358668 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.358654 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5684cc05-c20a-4911-b249-557604cbac27" containerName="maas-api" Jul 22 15:49:59.358713 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.358669 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="5684cc05-c20a-4911-b249-557604cbac27" containerName="maas-api" Jul 22 15:49:59.358748 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.358731 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="5684cc05-c20a-4911-b249-557604cbac27" containerName="maas-api" Jul 22 15:49:59.361624 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.361608 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.364020 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.364000 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:49:59.364020 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.364005 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c24af7-serving-cert\"" Jul 22 15:49:59.364200 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.364064 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:49:59.364802 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.364789 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:49:59.371256 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.371200 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:49:59.422091 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.422063 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:59.467349 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.467278 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.467349 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.467309 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.467531 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.467352 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5754p\" (UniqueName: \"kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.566379 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.566325 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:49:59.568394 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.568365 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.568507 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.568401 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.568507 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.568438 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5754p\" (UniqueName: \"kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.569220 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.569202 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.571008 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.570987 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.580752 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.580728 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5754p\" (UniqueName: \"kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p\") pod \"maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.673456 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.673427 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:49:59.817394 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.817362 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:49:59.821470 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:49:59.821444 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f12c209_57cd_4b17_b5b1_aa77bb341ffc.slice/crio-6ceb6deeb5bbc318842e8e04eb29250377a34917ba9c7ac24f592d0a7c864f50 WatchSource:0}: Error finding container 6ceb6deeb5bbc318842e8e04eb29250377a34917ba9c7ac24f592d0a7c864f50: Status 404 returned error can't find the container with id 6ceb6deeb5bbc318842e8e04eb29250377a34917ba9c7ac24f592d0a7c864f50 Jul 22 15:49:59.822872 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.822855 2542 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 15:49:59.906789 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.906760 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" event={"ID":"2f12c209-57cd-4b17-b5b1-aa77bb341ffc","Type":"ContainerStarted","Data":"6ceb6deeb5bbc318842e8e04eb29250377a34917ba9c7ac24f592d0a7c864f50"} Jul 22 15:49:59.995543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:49:59.995466 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:00.095337 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:00.095307 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:00.913262 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:00.913178 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" event={"ID":"2f12c209-57cd-4b17-b5b1-aa77bb341ffc","Type":"ContainerStarted","Data":"cc8a90e5a80fe71751f4441e48bf372075281bee42c60ea742cb8f5bf5cd6e76"} Jul 22 15:50:00.913609 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:00.913337 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:50:00.932151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:00.932107 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" podStartSLOduration=1.114679824 podStartE2EDuration="1.932093212s" totalImagesPullingTime="817.413388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:50:00.931430244 +0000 UTC m=+2231.291512494" watchObservedRunningTime="2026-07-22 15:50:00.932093212 +0000 UTC m=+2231.292175461" Jul 22 15:50:03.741918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:03.741881 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:04.082258 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:04.082225 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:04.658929 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:04.658895 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:04.762765 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:04.762732 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:05.538034 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:05.538000 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:50:06.923687 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:06.923629 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:50:07.316474 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.316379 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:07.412777 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.412738 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:07.508414 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.508378 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:50:07.512172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.512149 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.514495 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.514475 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-cdfa08-serving-cert\"" Jul 22 15:50:07.521896 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.521870 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:50:07.547196 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.547164 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:07.642784 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.642748 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtgcp\" (UniqueName: \"kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.642959 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.642804 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.642959 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.642879 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.657597 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.657564 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:07.743858 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.743821 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.744045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.743871 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtgcp\" (UniqueName: \"kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.744045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.743913 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.744474 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.744452 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.746481 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.746458 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.754002 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.753977 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtgcp\" (UniqueName: \"kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp\") pod \"maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.823407 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.823370 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:07.970769 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:07.970740 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:50:07.974009 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:50:07.973982 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3aeeb15_fe96_4640_a6fa_8444c05b1f77.slice/crio-737e533c2ad63d5f7997948d55be9f8e9a688346b09848ffe196149cd9d6de95 WatchSource:0}: Error finding container 737e533c2ad63d5f7997948d55be9f8e9a688346b09848ffe196149cd9d6de95: Status 404 returned error can't find the container with id 737e533c2ad63d5f7997948d55be9f8e9a688346b09848ffe196149cd9d6de95 Jul 22 15:50:08.028300 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.028264 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:08.202050 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.201951 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:08.956971 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.956936 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" event={"ID":"d3aeeb15-fe96-4640-a6fa-8444c05b1f77","Type":"ContainerStarted","Data":"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d"} Jul 22 15:50:08.957151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.956988 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" event={"ID":"d3aeeb15-fe96-4640-a6fa-8444c05b1f77","Type":"ContainerStarted","Data":"737e533c2ad63d5f7997948d55be9f8e9a688346b09848ffe196149cd9d6de95"} Jul 22 15:50:08.957151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.957026 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:08.975126 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:08.975073 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" podStartSLOduration=1.458196138 podStartE2EDuration="1.975051836s" totalImagesPullingTime="516.855698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:50:08.973918896 +0000 UTC m=+2239.334001144" watchObservedRunningTime="2026-07-22 15:50:08.975051836 +0000 UTC m=+2239.335134084" Jul 22 15:50:11.826570 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:11.826473 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:14.967803 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:14.967768 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:50:20.889784 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:20.889745 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:20.992813 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:20.992775 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:21.718284 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:21.718250 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:50:28.351361 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:28.351325 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:28.813927 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:28.813835 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:28.918912 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:28.918877 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:30.720138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:30.720102 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:50:44.820492 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:44.820455 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:50:49.993153 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:49.993120 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:50:55.318852 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:50:55.318815 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:51:08.519516 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:08.519484 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:51:31.594612 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:31.594573 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:32.832997 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:32.832954 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:33.302892 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:33.302805 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:33.403295 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:33.403266 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:36.417619 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:36.417557 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:36.519116 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:36.519080 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:36.519902 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:36.519880 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:51:43.050425 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.050339 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:51:43.050877 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.050564 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" podUID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" containerName="maas-api" containerID="cri-o://cc8a90e5a80fe71751f4441e48bf372075281bee42c60ea742cb8f5bf5cd6e76" gracePeriod=30 Jul 22 15:51:43.079657 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.079611 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:43.446283 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.446253 2542 generic.go:356] "Generic (PLEG): container finished" podID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" containerID="cc8a90e5a80fe71751f4441e48bf372075281bee42c60ea742cb8f5bf5cd6e76" exitCode=0 Jul 22 15:51:43.446426 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.446301 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" event={"ID":"2f12c209-57cd-4b17-b5b1-aa77bb341ffc","Type":"ContainerDied","Data":"cc8a90e5a80fe71751f4441e48bf372075281bee42c60ea742cb8f5bf5cd6e76"} Jul 22 15:51:43.497925 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.497903 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:51:43.577082 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.577019 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls\") pod \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " Jul 22 15:51:43.577082 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.577055 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5754p\" (UniqueName: \"kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p\") pod \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " Jul 22 15:51:43.577262 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.577104 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca\") pod \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\" (UID: \"2f12c209-57cd-4b17-b5b1-aa77bb341ffc\") " Jul 22 15:51:43.577481 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.577459 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2f12c209-57cd-4b17-b5b1-aa77bb341ffc" (UID: "2f12c209-57cd-4b17-b5b1-aa77bb341ffc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:51:43.579203 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.579173 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p" (OuterVolumeSpecName: "kube-api-access-5754p") pod "2f12c209-57cd-4b17-b5b1-aa77bb341ffc" (UID: "2f12c209-57cd-4b17-b5b1-aa77bb341ffc"). InnerVolumeSpecName "kube-api-access-5754p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:51:43.579203 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.579175 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2f12c209-57cd-4b17-b5b1-aa77bb341ffc" (UID: "2f12c209-57cd-4b17-b5b1-aa77bb341ffc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:51:43.678071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.678047 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:51:43.678071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.678070 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:51:43.678198 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:43.678086 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5754p\" (UniqueName: \"kubernetes.io/projected/2f12c209-57cd-4b17-b5b1-aa77bb341ffc-kube-api-access-5754p\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:51:44.452206 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:44.452141 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" Jul 22 15:51:44.452611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:44.452144 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs" event={"ID":"2f12c209-57cd-4b17-b5b1-aa77bb341ffc","Type":"ContainerDied","Data":"6ceb6deeb5bbc318842e8e04eb29250377a34917ba9c7ac24f592d0a7c864f50"} Jul 22 15:51:44.452611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:44.452268 2542 scope.go:117] "RemoveContainer" containerID="cc8a90e5a80fe71751f4441e48bf372075281bee42c60ea742cb8f5bf5cd6e76" Jul 22 15:51:44.468805 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:44.468784 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:51:44.473061 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:44.473043 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c24af7-ff9c75595-lj7cs"] Jul 22 15:51:46.121009 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:46.120975 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" path="/var/lib/kubelet/pods/2f12c209-57cd-4b17-b5b1-aa77bb341ffc/volumes" Jul 22 15:51:47.699037 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:47.699003 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:48.214695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:48.214658 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:51.826460 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:51.826424 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:51:53.899311 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:53.899284 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:53.965511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:53.965483 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:54.178963 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:54.178885 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:54.401870 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:54.401818 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:55.178859 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:55.178829 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:51:55.279197 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:51:55.279156 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:04.989071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:04.989041 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:52:04.989550 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:04.989232 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" podUID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" containerName="maas-api" containerID="cri-o://5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d" gracePeriod=30 Jul 22 15:52:05.037025 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.036989 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:05.432139 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.432120 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:52:05.532281 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.532203 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtgcp\" (UniqueName: \"kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp\") pod \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " Jul 22 15:52:05.532406 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.532296 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls\") pod \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " Jul 22 15:52:05.532406 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.532340 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca\") pod \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\" (UID: \"d3aeeb15-fe96-4640-a6fa-8444c05b1f77\") " Jul 22 15:52:05.532716 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.532696 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3aeeb15-fe96-4640-a6fa-8444c05b1f77" (UID: "d3aeeb15-fe96-4640-a6fa-8444c05b1f77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:52:05.534469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.534448 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3aeeb15-fe96-4640-a6fa-8444c05b1f77" (UID: "d3aeeb15-fe96-4640-a6fa-8444c05b1f77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:52:05.534469 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.534455 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp" (OuterVolumeSpecName: "kube-api-access-dtgcp") pod "d3aeeb15-fe96-4640-a6fa-8444c05b1f77" (UID: "d3aeeb15-fe96-4640-a6fa-8444c05b1f77"). InnerVolumeSpecName "kube-api-access-dtgcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:52:05.556005 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.555982 2542 generic.go:356] "Generic (PLEG): container finished" podID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" containerID="5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d" exitCode=0 Jul 22 15:52:05.556095 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.556031 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" Jul 22 15:52:05.556144 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.556027 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" event={"ID":"d3aeeb15-fe96-4640-a6fa-8444c05b1f77","Type":"ContainerDied","Data":"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d"} Jul 22 15:52:05.556179 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.556142 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g" event={"ID":"d3aeeb15-fe96-4640-a6fa-8444c05b1f77","Type":"ContainerDied","Data":"737e533c2ad63d5f7997948d55be9f8e9a688346b09848ffe196149cd9d6de95"} Jul 22 15:52:05.556179 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.556165 2542 scope.go:117] "RemoveContainer" containerID="5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d" Jul 22 15:52:05.565138 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.565122 2542 scope.go:117] "RemoveContainer" containerID="5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d" Jul 22 15:52:05.565344 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:05.565327 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d\": container with ID starting with 5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d not found: ID does not exist" containerID="5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d" Jul 22 15:52:05.565389 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.565352 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d"} err="failed to get container status \"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d\": rpc error: code = NotFound desc = could not find container \"5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d\": container with ID starting with 5088aea18433d3a4adfd0cb5243b642f638dd9c81a0819d23954a16bb54ff94d not found: ID does not exist" Jul 22 15:52:05.576836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.576811 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:52:05.581158 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.581141 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cdfa08-57b6f5d6bc-vnc6g"] Jul 22 15:52:05.633776 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.633759 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtgcp\" (UniqueName: \"kubernetes.io/projected/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-kube-api-access-dtgcp\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:05.633776 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.633775 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:05.633918 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:05.633784 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3aeeb15-fe96-4640-a6fa-8444c05b1f77-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:06.121588 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:06.121559 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" path="/var/lib/kubelet/pods/d3aeeb15-fe96-4640-a6fa-8444c05b1f77/volumes" Jul 22 15:52:07.823792 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:07.823759 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:52:09.624885 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:09.624852 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:10.104375 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:10.104349 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:16.094494 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:16.094457 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:16.165748 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:16.165715 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:16.370951 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:16.370857 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:16.597575 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:16.597541 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:16.954485 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:16.954453 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:17.314374 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:17.314282 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:17.414081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:17.414051 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:19.432836 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:19.432803 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:19.533679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:19.533646 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:19.997735 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:19.997698 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:20.088584 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.088552 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:20.089492 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089470 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:20.089823 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089802 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" containerName="maas-api" Jul 22 15:52:20.089823 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089823 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" containerName="maas-api" Jul 22 15:52:20.089991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089835 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" containerName="maas-api" Jul 22 15:52:20.089991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089840 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" containerName="maas-api" Jul 22 15:52:20.089991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089929 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3aeeb15-fe96-4640-a6fa-8444c05b1f77" containerName="maas-api" Jul 22 15:52:20.089991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.089942 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f12c209-57cd-4b17-b5b1-aa77bb341ffc" containerName="maas-api" Jul 22 15:52:20.094238 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.094220 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.096951 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.096920 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:52:20.097081 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.097056 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:52:20.097759 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.097741 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:52:20.097946 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.097926 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-063391-serving-cert\"" Jul 22 15:52:20.105195 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.105176 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:20.134569 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.134542 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkhtb\" (UniqueName: \"kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.134737 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.134594 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.134737 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.134617 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.170102 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.170076 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:20.235477 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.235449 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkhtb\" (UniqueName: \"kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.235584 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.235495 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.235584 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.235517 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.235680 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:20.235624 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-063391-serving-cert: secret "maas-api-e2e-api-a-063391-serving-cert" not found Jul 22 15:52:20.235752 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:20.235718 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls podName:d2fa3bd2-1508-4634-b25f-31125867066e nodeName:}" failed. No retries permitted until 2026-07-22 15:52:20.735697906 +0000 UTC m=+2371.095780149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls") pod "maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" (UID: "d2fa3bd2-1508-4634-b25f-31125867066e") : secret "maas-api-e2e-api-a-063391-serving-cert" not found Jul 22 15:52:20.236172 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.236153 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.245911 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.245882 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkhtb\" (UniqueName: \"kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.738743 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.738706 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:20.739123 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:20.738810 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-063391-serving-cert: secret "maas-api-e2e-api-a-063391-serving-cert" not found Jul 22 15:52:20.739123 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:20.738867 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls podName:d2fa3bd2-1508-4634-b25f-31125867066e nodeName:}" failed. No retries permitted until 2026-07-22 15:52:21.738853543 +0000 UTC m=+2372.098935771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls") pod "maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" (UID: "d2fa3bd2-1508-4634-b25f-31125867066e") : secret "maas-api-e2e-api-a-063391-serving-cert" not found Jul 22 15:52:20.786738 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.786697 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:20.884532 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.884504 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:20.987695 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:20.987630 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:21.744734 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:21.744705 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:21.747167 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:21.747135 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:21.905806 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:21.905780 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:22.034820 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:22.034795 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:22.036730 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:52:22.036702 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fa3bd2_1508_4634_b25f_31125867066e.slice/crio-cea05191b07ad8e1a32d3215b022c6fe946b7f6076acdef17079f39c34652082 WatchSource:0}: Error finding container cea05191b07ad8e1a32d3215b022c6fe946b7f6076acdef17079f39c34652082: Status 404 returned error can't find the container with id cea05191b07ad8e1a32d3215b022c6fe946b7f6076acdef17079f39c34652082 Jul 22 15:52:22.639414 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:22.639385 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" event={"ID":"d2fa3bd2-1508-4634-b25f-31125867066e","Type":"ContainerStarted","Data":"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec"} Jul 22 15:52:22.639545 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:22.639436 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" event={"ID":"d2fa3bd2-1508-4634-b25f-31125867066e","Type":"ContainerStarted","Data":"cea05191b07ad8e1a32d3215b022c6fe946b7f6076acdef17079f39c34652082"} Jul 22 15:52:22.639545 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:22.639488 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:22.660177 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:22.660134 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" podStartSLOduration=2.170374018 podStartE2EDuration="2.660118648s" totalImagesPullingTime="489.74463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:52:22.658794197 +0000 UTC m=+2373.018876446" watchObservedRunningTime="2026-07-22 15:52:22.660118648 +0000 UTC m=+2373.020200895" Jul 22 15:52:24.427893 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:24.427853 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:24.899994 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:24.899953 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:25.232336 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:25.232256 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:25.526099 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:25.526008 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.014601 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.014554 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.100650 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.100611 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:52:28.103186 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.103141 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.104061 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.104046 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.107509 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.107489 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f08216-serving-cert\"" Jul 22 15:52:28.122791 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.122771 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:52:28.179897 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.179872 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.192090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.192075 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.192163 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.192099 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.192163 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.192140 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25dmb\" (UniqueName: \"kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.293402 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.293346 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25dmb\" (UniqueName: \"kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.293513 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.293400 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.293513 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:28.293472 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-serving-cert: secret "maas-api-e2e-api-b-f08216-serving-cert" not found Jul 22 15:52:28.293611 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:28.293523 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls podName:a6619938-1235-4666-9e47-1328ceeb57fa nodeName:}" failed. No retries permitted until 2026-07-22 15:52:28.793506798 +0000 UTC m=+2379.153589038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls") pod "maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" (UID: "a6619938-1235-4666-9e47-1328ceeb57fa") : secret "maas-api-e2e-api-b-f08216-serving-cert" not found Jul 22 15:52:28.293611 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.293513 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.294217 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.294198 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.308377 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.308359 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25dmb\" (UniqueName: \"kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.526771 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.526741 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:52:28.534615 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.534584 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.649783 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.649764 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:28.707285 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.707251 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:28.797921 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.797895 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.800245 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.800228 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") pod \"maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:28.807511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:28.807486 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:29.014420 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:29.014358 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:29.169167 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:29.169139 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:52:29.172999 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:52:29.172970 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6619938_1235_4666_9e47_1328ceeb57fa.slice/crio-fe6d51fedcfac6bd6aa56896ee99d310cafb59e8e1894339543efb46aac9da1c WatchSource:0}: Error finding container fe6d51fedcfac6bd6aa56896ee99d310cafb59e8e1894339543efb46aac9da1c: Status 404 returned error can't find the container with id fe6d51fedcfac6bd6aa56896ee99d310cafb59e8e1894339543efb46aac9da1c Jul 22 15:52:29.676413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:29.676390 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" event={"ID":"a6619938-1235-4666-9e47-1328ceeb57fa","Type":"ContainerStarted","Data":"fe6d51fedcfac6bd6aa56896ee99d310cafb59e8e1894339543efb46aac9da1c"} Jul 22 15:52:30.683190 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:30.683156 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" event={"ID":"a6619938-1235-4666-9e47-1328ceeb57fa","Type":"ContainerStarted","Data":"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4"} Jul 22 15:52:30.683671 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:30.683291 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:30.701697 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:30.701657 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" podStartSLOduration=2.223136106 podStartE2EDuration="2.701629583s" totalImagesPullingTime="478.493477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:52:30.700376273 +0000 UTC m=+2381.060458521" watchObservedRunningTime="2026-07-22 15:52:30.701629583 +0000 UTC m=+2381.061711831" Jul 22 15:52:32.423786 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:32.423741 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:36.692746 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:36.692714 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:52:41.050348 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:41.050320 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:41.151509 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:41.151470 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:44.371048 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:44.371017 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:52:49.572333 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:49.572290 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:49.680627 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:49.680575 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:51.142259 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:51.142200 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:51.238535 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:51.238507 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:56.384173 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.384141 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:56.384730 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.384332 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" podUID="d2fa3bd2-1508-4634-b25f-31125867066e" containerName="maas-api" containerID="cri-o://24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec" gracePeriod=30 Jul 22 15:52:56.399071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.399034 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:52:56.631402 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.631375 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:56.709302 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.709219 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca\") pod \"d2fa3bd2-1508-4634-b25f-31125867066e\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " Jul 22 15:52:56.709302 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.709264 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") pod \"d2fa3bd2-1508-4634-b25f-31125867066e\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " Jul 22 15:52:56.709537 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.709319 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkhtb\" (UniqueName: \"kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb\") pod \"d2fa3bd2-1508-4634-b25f-31125867066e\" (UID: \"d2fa3bd2-1508-4634-b25f-31125867066e\") " Jul 22 15:52:56.709667 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.709620 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2fa3bd2-1508-4634-b25f-31125867066e" (UID: "d2fa3bd2-1508-4634-b25f-31125867066e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:52:56.711608 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.711583 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb" (OuterVolumeSpecName: "kube-api-access-tkhtb") pod "d2fa3bd2-1508-4634-b25f-31125867066e" (UID: "d2fa3bd2-1508-4634-b25f-31125867066e"). InnerVolumeSpecName "kube-api-access-tkhtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:52:56.711608 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.711592 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2fa3bd2-1508-4634-b25f-31125867066e" (UID: "d2fa3bd2-1508-4634-b25f-31125867066e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:52:56.810304 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.810278 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fa3bd2-1508-4634-b25f-31125867066e-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:56.810304 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.810302 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2fa3bd2-1508-4634-b25f-31125867066e-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:56.810304 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.810312 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkhtb\" (UniqueName: \"kubernetes.io/projected/d2fa3bd2-1508-4634-b25f-31125867066e-kube-api-access-tkhtb\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:52:56.813546 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.813517 2542 generic.go:356] "Generic (PLEG): container finished" podID="d2fa3bd2-1508-4634-b25f-31125867066e" containerID="24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec" exitCode=0 Jul 22 15:52:56.813679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.813583 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" Jul 22 15:52:56.813679 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.813596 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" event={"ID":"d2fa3bd2-1508-4634-b25f-31125867066e","Type":"ContainerDied","Data":"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec"} Jul 22 15:52:56.813756 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.813694 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r" event={"ID":"d2fa3bd2-1508-4634-b25f-31125867066e","Type":"ContainerDied","Data":"cea05191b07ad8e1a32d3215b022c6fe946b7f6076acdef17079f39c34652082"} Jul 22 15:52:56.813756 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.813718 2542 scope.go:117] "RemoveContainer" containerID="24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec" Jul 22 15:52:56.826258 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.826240 2542 scope.go:117] "RemoveContainer" containerID="24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec" Jul 22 15:52:56.826537 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:52:56.826517 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec\": container with ID starting with 24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec not found: ID does not exist" containerID="24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec" Jul 22 15:52:56.826597 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.826550 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec"} err="failed to get container status \"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec\": rpc error: code = NotFound desc = could not find container \"24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec\": container with ID starting with 24dda9d9df2cf33c76e20185c375c45c8e2b1e08b753e99497a48f1bcbc846ec not found: ID does not exist" Jul 22 15:52:56.835934 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.835912 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:56.839895 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:56.839875 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-063391-d5fbc64cc-xbx6r"] Jul 22 15:52:58.121915 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:52:58.121873 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2fa3bd2-1508-4634-b25f-31125867066e" path="/var/lib/kubelet/pods/d2fa3bd2-1508-4634-b25f-31125867066e/volumes" Jul 22 15:53:00.523844 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:00.523815 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:00.920422 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:00.920392 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:01.038470 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:01.038440 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:53:06.720965 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:06.720925 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:06.783743 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:06.783708 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:06.990734 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:06.990592 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:07.200703 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:07.200661 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:08.159475 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:08.159440 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:08.259070 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:08.259030 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:22.870984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:22.870895 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:53:22.871413 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:22.871135 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" podUID="a6619938-1235-4666-9e47-1328ceeb57fa" containerName="maas-api" containerID="cri-o://c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4" gracePeriod=30 Jul 22 15:53:22.911351 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:22.911322 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:23.113294 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.113271 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:53:23.223905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.223842 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") pod \"a6619938-1235-4666-9e47-1328ceeb57fa\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " Jul 22 15:53:23.223905 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.223897 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca\") pod \"a6619938-1235-4666-9e47-1328ceeb57fa\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " Jul 22 15:53:23.224105 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.223940 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25dmb\" (UniqueName: \"kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb\") pod \"a6619938-1235-4666-9e47-1328ceeb57fa\" (UID: \"a6619938-1235-4666-9e47-1328ceeb57fa\") " Jul 22 15:53:23.224313 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.224280 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6619938-1235-4666-9e47-1328ceeb57fa" (UID: "a6619938-1235-4666-9e47-1328ceeb57fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 15:53:23.225999 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.225975 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6619938-1235-4666-9e47-1328ceeb57fa" (UID: "a6619938-1235-4666-9e47-1328ceeb57fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 15:53:23.226111 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.226088 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb" (OuterVolumeSpecName: "kube-api-access-25dmb") pod "a6619938-1235-4666-9e47-1328ceeb57fa" (UID: "a6619938-1235-4666-9e47-1328ceeb57fa"). InnerVolumeSpecName "kube-api-access-25dmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 15:53:23.324802 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.324777 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6619938-1235-4666-9e47-1328ceeb57fa-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:53:23.324802 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.324801 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25dmb\" (UniqueName: \"kubernetes.io/projected/a6619938-1235-4666-9e47-1328ceeb57fa-kube-api-access-25dmb\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:53:23.324926 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.324817 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6619938-1235-4666-9e47-1328ceeb57fa-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 15:53:23.955628 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.955594 2542 generic.go:356] "Generic (PLEG): container finished" podID="a6619938-1235-4666-9e47-1328ceeb57fa" containerID="c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4" exitCode=0 Jul 22 15:53:23.956051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.955657 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" Jul 22 15:53:23.956051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.955678 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" event={"ID":"a6619938-1235-4666-9e47-1328ceeb57fa","Type":"ContainerDied","Data":"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4"} Jul 22 15:53:23.956051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.955729 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk" event={"ID":"a6619938-1235-4666-9e47-1328ceeb57fa","Type":"ContainerDied","Data":"fe6d51fedcfac6bd6aa56896ee99d310cafb59e8e1894339543efb46aac9da1c"} Jul 22 15:53:23.956051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.955753 2542 scope.go:117] "RemoveContainer" containerID="c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4" Jul 22 15:53:23.964755 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.964735 2542 scope.go:117] "RemoveContainer" containerID="c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4" Jul 22 15:53:23.965015 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:53:23.964994 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4\": container with ID starting with c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4 not found: ID does not exist" containerID="c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4" Jul 22 15:53:23.965068 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.965024 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4"} err="failed to get container status \"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4\": rpc error: code = NotFound desc = could not find container \"c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4\": container with ID starting with c6815a6c78d41636d916b795c31f2b191f5fef091b0e9aa9b9bd99afc14994d4 not found: ID does not exist" Jul 22 15:53:23.977588 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.977563 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:53:23.987680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:23.984358 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f08216-6b64f6cfdc-l9nsk"] Jul 22 15:53:24.124219 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:24.124189 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6619938-1235-4666-9e47-1328ceeb57fa" path="/var/lib/kubelet/pods/a6619938-1235-4666-9e47-1328ceeb57fa/volumes" Jul 22 15:53:27.406200 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:27.406166 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:27.428822 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:27.428794 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:53:27.819982 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:27.819899 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:33.490547 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:33.490509 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:33.550493 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:33.550454 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:33.778227 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:33.778085 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:33.999995 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:33.999964 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:34.338465 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:34.338430 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:34.652595 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:34.652482 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:34.875369 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:34.875341 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:37.344837 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.344803 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:37.423330 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423299 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 15:53:37.423631 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423620 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6619938-1235-4666-9e47-1328ceeb57fa" containerName="maas-api" Jul 22 15:53:37.423701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423650 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6619938-1235-4666-9e47-1328ceeb57fa" containerName="maas-api" Jul 22 15:53:37.423701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423662 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2fa3bd2-1508-4634-b25f-31125867066e" containerName="maas-api" Jul 22 15:53:37.423701 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423668 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2fa3bd2-1508-4634-b25f-31125867066e" containerName="maas-api" Jul 22 15:53:37.423816 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423718 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6619938-1235-4666-9e47-1328ceeb57fa" containerName="maas-api" Jul 22 15:53:37.423816 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.423726 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2fa3bd2-1508-4634-b25f-31125867066e" containerName="maas-api" Jul 22 15:53:37.428991 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.428390 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.432783 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.432750 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.432996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.432833 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnz6\" (UniqueName: \"kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.432996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.432898 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.432996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.432954 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-290ac7-serving-cert\"" Jul 22 15:53:37.432996 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.432974 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 15:53:37.433351 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.433126 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\"" Jul 22 15:53:37.433986 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.433960 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 15:53:37.434461 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.434413 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:37.438896 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.438872 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 15:53:37.510935 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.510891 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:37.534090 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.534062 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.534202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.534109 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnz6\" (UniqueName: \"kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.534202 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.534140 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.534281 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:53:37.534249 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-serving-cert: secret "maas-api-e2e-shared-a-290ac7-serving-cert" not found Jul 22 15:53:37.534328 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:53:37.534318 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls podName:75067fbb-c26f-42c7-bce1-9439d26f0905 nodeName:}" failed. No retries permitted until 2026-07-22 15:53:38.03430003 +0000 UTC m=+2448.394382274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls") pod "maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" (UID: "75067fbb-c26f-42c7-bce1-9439d26f0905") : secret "maas-api-e2e-shared-a-290ac7-serving-cert" not found Jul 22 15:53:37.534736 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.534719 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:37.544342 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:37.544315 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnz6\" (UniqueName: \"kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:38.026543 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.026485 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:38.037664 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.037628 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:38.040167 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.040147 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") pod \"maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:38.044019 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.043999 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:38.125950 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.125919 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:38.208775 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:38.208746 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 15:53:38.209838 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:53:38.209802 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75067fbb_c26f_42c7_bce1_9439d26f0905.slice/crio-cfe705fe96fead04f4c40f8de05d27b50250a66496a6c2bec341777549a71754 WatchSource:0}: Error finding container cfe705fe96fead04f4c40f8de05d27b50250a66496a6c2bec341777549a71754: Status 404 returned error can't find the container with id cfe705fe96fead04f4c40f8de05d27b50250a66496a6c2bec341777549a71754 Jul 22 15:53:39.033385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:39.033311 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" event={"ID":"75067fbb-c26f-42c7-bce1-9439d26f0905","Type":"ContainerStarted","Data":"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236"} Jul 22 15:53:39.033385 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:39.033361 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" event={"ID":"75067fbb-c26f-42c7-bce1-9439d26f0905","Type":"ContainerStarted","Data":"cfe705fe96fead04f4c40f8de05d27b50250a66496a6c2bec341777549a71754"} Jul 22 15:53:39.033774 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:39.033445 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:39.052775 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:39.052732 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" podStartSLOduration=1.6455918 podStartE2EDuration="2.052718552s" totalImagesPullingTime="407.126752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:53:39.050723051 +0000 UTC m=+2449.410805301" watchObservedRunningTime="2026-07-22 15:53:39.052718552 +0000 UTC m=+2449.412800800" Jul 22 15:53:41.848051 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:41.848020 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:42.164849 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:42.164760 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:42.478702 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:42.478575 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:42.714594 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:42.714563 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:43.022345 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:43.022313 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:53:45.044060 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.044033 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 15:53:45.377680 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.377629 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:45.456205 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.456175 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 15:53:45.459887 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.459866 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.462020 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.462001 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9911b9-serving-cert\"" Jul 22 15:53:45.470105 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.470084 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 15:53:45.472874 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.472850 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:45.500625 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.500596 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.500780 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.500660 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmvz\" (UniqueName: \"kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.500780 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.500705 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.539526 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.539497 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:45.601326 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.601291 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.601511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.601335 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmvz\" (UniqueName: \"kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.601511 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.601384 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.601663 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:53:45.601524 2542 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-serving-cert: secret "maas-api-e2e-shared-b-9911b9-serving-cert" not found Jul 22 15:53:45.601663 ip-10-0-136-36 kubenswrapper[2542]: E0722 15:53:45.601597 2542 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls podName:6ac812c1-8926-4286-8b47-49e1d31a303d nodeName:}" failed. No retries permitted until 2026-07-22 15:53:46.101576044 +0000 UTC m=+2456.461658273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls") pod "maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" (UID: "6ac812c1-8926-4286-8b47-49e1d31a303d") : secret "maas-api-e2e-shared-b-9911b9-serving-cert" not found Jul 22 15:53:45.602050 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.602030 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.610959 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.610935 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmvz\" (UniqueName: \"kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:45.925932 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:45.925897 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:46.106203 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.106173 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:46.108727 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.108709 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") pod \"maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:46.309127 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.309051 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:46.371066 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.371023 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:46.411574 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.411531 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:46.505586 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:46.505510 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 15:53:46.507998 ip-10-0-136-36 kubenswrapper[2542]: W0722 15:53:46.507972 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac812c1_8926_4286_8b47_49e1d31a303d.slice/crio-67e5142faa6e2e70d856c01bafd55732f8c619203f9d6e7c7966acfbfc704436 WatchSource:0}: Error finding container 67e5142faa6e2e70d856c01bafd55732f8c619203f9d6e7c7966acfbfc704436: Status 404 returned error can't find the container with id 67e5142faa6e2e70d856c01bafd55732f8c619203f9d6e7c7966acfbfc704436 Jul 22 15:53:47.077605 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:47.077572 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" event={"ID":"6ac812c1-8926-4286-8b47-49e1d31a303d","Type":"ContainerStarted","Data":"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9"} Jul 22 15:53:47.077772 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:47.077622 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" event={"ID":"6ac812c1-8926-4286-8b47-49e1d31a303d","Type":"ContainerStarted","Data":"67e5142faa6e2e70d856c01bafd55732f8c619203f9d6e7c7966acfbfc704436"} Jul 22 15:53:47.083884 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:47.079024 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:47.099440 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:47.099361 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" podStartSLOduration=1.7611138739999999 podStartE2EDuration="2.099347534s" totalImagesPullingTime="338.23366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:53:47.09854128 +0000 UTC m=+2457.458623530" watchObservedRunningTime="2026-07-22 15:53:47.099347534 +0000 UTC m=+2457.459429783" Jul 22 15:53:48.447151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:48.447115 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:48.550764 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:48.550732 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:49.892988 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:49.892953 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:53.089773 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:53.089738 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 15:53:58.898354 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:58.898314 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:58.998835 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:58.998800 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:53:59.838540 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:53:59.838494 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:54:07.050754 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:54:07.050720 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:54:07.148602 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:54:07.148575 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:54:11.150277 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:54:11.150238 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:54:14.832045 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:54:14.832003 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:55:00.032948 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:00.032864 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:55:03.721262 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:03.721232 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:55:18.798224 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:18.798185 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:55:20.319676 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:20.319628 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:55:25.062296 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:25.062259 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:55:37.425092 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:37.425063 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:55:58.428479 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:55:58.428442 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:56:17.231788 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:56:17.231699 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:56:33.030700 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:56:33.030663 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:56:46.736506 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:56:46.736464 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:56:52.423827 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:56:52.423790 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:56:59.201984 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:56:59.201941 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:57:09.426886 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:09.426856 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:57:14.047388 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:14.047347 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:57:15.092447 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:15.092415 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:57:26.321052 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:26.321017 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:57:27.662814 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:27.662782 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:57:36.135168 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:36.135135 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:57:53.065071 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:53.065036 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:57:57.119308 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:57:57.119278 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:58:15.212651 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:15.212597 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:58:32.828825 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:32.828777 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:58:39.489609 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:39.489575 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:40.261399 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:40.261353 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:49.199151 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:49.199114 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:49.301432 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:49.301402 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:49.869255 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:49.869223 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:50.428218 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:50.428190 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:58:59.809826 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:59.809776 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:59.910020 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:59.909983 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:58:59.943496 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:58:59.943471 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:59:04.942019 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:04.941982 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:59:07.838246 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:07.838213 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:59:07.943850 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:07.943790 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:59:08.081113 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:08.081079 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:59:30.428514 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:30.428424 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:59:46.951710 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:46.951676 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 15:59:52.439579 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:52.439551 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 15:59:53.272697 ip-10-0-136-36 kubenswrapper[2542]: I0722 15:59:53.272665 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:05.718310 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:05.718268 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 16:00:18.493304 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:18.493272 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:18.593908 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:18.593881 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:28.388994 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.388964 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 16:00:28.389366 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.389163 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" podUID="75067fbb-c26f-42c7-bce1-9439d26f0905" containerName="maas-api" containerID="cri-o://8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236" gracePeriod=30 Jul 22 16:00:28.403477 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.403447 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:28.625284 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.625262 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 16:00:28.754540 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.754476 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") pod \"75067fbb-c26f-42c7-bce1-9439d26f0905\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " Jul 22 16:00:28.754540 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.754524 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca\") pod \"75067fbb-c26f-42c7-bce1-9439d26f0905\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " Jul 22 16:00:28.754712 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.754584 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wnz6\" (UniqueName: \"kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6\") pod \"75067fbb-c26f-42c7-bce1-9439d26f0905\" (UID: \"75067fbb-c26f-42c7-bce1-9439d26f0905\") " Jul 22 16:00:28.754914 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.754889 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75067fbb-c26f-42c7-bce1-9439d26f0905" (UID: "75067fbb-c26f-42c7-bce1-9439d26f0905"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:00:28.756610 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.756585 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75067fbb-c26f-42c7-bce1-9439d26f0905" (UID: "75067fbb-c26f-42c7-bce1-9439d26f0905"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:00:28.756894 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.756873 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6" (OuterVolumeSpecName: "kube-api-access-8wnz6") pod "75067fbb-c26f-42c7-bce1-9439d26f0905" (UID: "75067fbb-c26f-42c7-bce1-9439d26f0905"). InnerVolumeSpecName "kube-api-access-8wnz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:00:28.855849 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.855827 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wnz6\" (UniqueName: \"kubernetes.io/projected/75067fbb-c26f-42c7-bce1-9439d26f0905-kube-api-access-8wnz6\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:28.855849 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.855848 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75067fbb-c26f-42c7-bce1-9439d26f0905-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:28.855981 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:28.855858 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75067fbb-c26f-42c7-bce1-9439d26f0905-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:29.090983 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.090951 2542 generic.go:356] "Generic (PLEG): container finished" podID="75067fbb-c26f-42c7-bce1-9439d26f0905" containerID="8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236" exitCode=0 Jul 22 16:00:29.091112 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.090999 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" event={"ID":"75067fbb-c26f-42c7-bce1-9439d26f0905","Type":"ContainerDied","Data":"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236"} Jul 22 16:00:29.091112 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.091015 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" Jul 22 16:00:29.091112 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.091060 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb" event={"ID":"75067fbb-c26f-42c7-bce1-9439d26f0905","Type":"ContainerDied","Data":"cfe705fe96fead04f4c40f8de05d27b50250a66496a6c2bec341777549a71754"} Jul 22 16:00:29.091112 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.091105 2542 scope.go:117] "RemoveContainer" containerID="8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236" Jul 22 16:00:29.100923 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.100904 2542 scope.go:117] "RemoveContainer" containerID="8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236" Jul 22 16:00:29.101214 ip-10-0-136-36 kubenswrapper[2542]: E0722 16:00:29.101194 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236\": container with ID starting with 8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236 not found: ID does not exist" containerID="8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236" Jul 22 16:00:29.101268 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.101223 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236"} err="failed to get container status \"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236\": rpc error: code = NotFound desc = could not find container \"8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236\": container with ID starting with 8e8164c6cc1b06a1f0a4fbd0eb04a78fdba8b07e4177662fbf02c9b3ac312236 not found: ID does not exist" Jul 22 16:00:29.112651 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.112611 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 16:00:29.117027 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:29.117007 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290ac7-6d4784944-xrlhb"] Jul 22 16:00:30.129257 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:30.129219 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75067fbb-c26f-42c7-bce1-9439d26f0905" path="/var/lib/kubelet/pods/75067fbb-c26f-42c7-bce1-9439d26f0905/volumes" Jul 22 16:00:31.220475 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:31.220438 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 16:00:33.441090 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:33.441066 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:33.544126 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:33.544089 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:39.427387 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:39.427311 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:39.535605 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:39.535574 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:39.721058 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:39.720983 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:39.958343 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:39.958309 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:40.866717 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:40.866677 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:40.966429 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:40.966399 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:50.516543 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.516511 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 16:00:50.517008 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.516793 2542 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" podUID="6ac812c1-8926-4286-8b47-49e1d31a303d" containerName="maas-api" containerID="cri-o://1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9" gracePeriod=30 Jul 22 16:00:50.560592 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.560562 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:50.759260 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.759239 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 16:00:50.925977 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.925948 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrmvz\" (UniqueName: \"kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz\") pod \"6ac812c1-8926-4286-8b47-49e1d31a303d\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " Jul 22 16:00:50.926158 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.925991 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca\") pod \"6ac812c1-8926-4286-8b47-49e1d31a303d\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " Jul 22 16:00:50.926158 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.926019 2542 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") pod \"6ac812c1-8926-4286-8b47-49e1d31a303d\" (UID: \"6ac812c1-8926-4286-8b47-49e1d31a303d\") " Jul 22 16:00:50.926337 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.926310 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ac812c1-8926-4286-8b47-49e1d31a303d" (UID: "6ac812c1-8926-4286-8b47-49e1d31a303d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:00:50.928301 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.928275 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ac812c1-8926-4286-8b47-49e1d31a303d" (UID: "6ac812c1-8926-4286-8b47-49e1d31a303d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:00:50.928409 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:50.928326 2542 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz" (OuterVolumeSpecName: "kube-api-access-jrmvz") pod "6ac812c1-8926-4286-8b47-49e1d31a303d" (UID: "6ac812c1-8926-4286-8b47-49e1d31a303d"). InnerVolumeSpecName "kube-api-access-jrmvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:00:51.027190 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.027169 2542 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrmvz\" (UniqueName: \"kubernetes.io/projected/6ac812c1-8926-4286-8b47-49e1d31a303d-kube-api-access-jrmvz\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:51.027190 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.027190 2542 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ac812c1-8926-4286-8b47-49e1d31a303d-openshift-service-ca\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:51.027315 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.027199 2542 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ac812c1-8926-4286-8b47-49e1d31a303d-maas-api-tls\") on node \"ip-10-0-136-36.ec2.internal\" DevicePath \"\"" Jul 22 16:00:51.204760 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.204693 2542 generic.go:356] "Generic (PLEG): container finished" podID="6ac812c1-8926-4286-8b47-49e1d31a303d" containerID="1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9" exitCode=0 Jul 22 16:00:51.204760 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.204729 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" event={"ID":"6ac812c1-8926-4286-8b47-49e1d31a303d","Type":"ContainerDied","Data":"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9"} Jul 22 16:00:51.204892 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.204791 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" event={"ID":"6ac812c1-8926-4286-8b47-49e1d31a303d","Type":"ContainerDied","Data":"67e5142faa6e2e70d856c01bafd55732f8c619203f9d6e7c7966acfbfc704436"} Jul 22 16:00:51.204892 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.204742 2542 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826" Jul 22 16:00:51.204892 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.204816 2542 scope.go:117] "RemoveContainer" containerID="1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9" Jul 22 16:00:51.215266 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.215249 2542 scope.go:117] "RemoveContainer" containerID="1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9" Jul 22 16:00:51.215571 ip-10-0-136-36 kubenswrapper[2542]: E0722 16:00:51.215550 2542 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9\": container with ID starting with 1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9 not found: ID does not exist" containerID="1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9" Jul 22 16:00:51.215631 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.215581 2542 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9"} err="failed to get container status \"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9\": rpc error: code = NotFound desc = could not find container \"1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9\": container with ID starting with 1f4e2843c1c7fabb32ec94178a940e436413840957231aaa2edf89c65bbca3b9 not found: ID does not exist" Jul 22 16:00:51.227799 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.227778 2542 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 16:00:51.232380 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:51.232352 2542 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9911b9-7b7f476bf4-q6826"] Jul 22 16:00:52.121498 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:52.121463 2542 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac812c1-8926-4286-8b47-49e1d31a303d" path="/var/lib/kubelet/pods/6ac812c1-8926-4286-8b47-49e1d31a303d/volumes" Jul 22 16:00:53.227734 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:53.227701 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9cqkt"] Jul 22 16:00:55.150228 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:55.150188 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:00:55.586004 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:00:55.585970 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:01.758731 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:01.758694 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:01.858736 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:01.858700 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:02.138865 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:02.138825 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:02.266704 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:02.266672 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:08.692533 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:08.692505 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-86wv9_e765079b-f902-46d2-a888-ae7df6f66a24/copy-manifests/0.log" Jul 22 16:01:08.699721 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:08.699692 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-86wv9_e765079b-f902-46d2-a888-ae7df6f66a24/manager/0.log" Jul 22 16:01:10.547590 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.547546 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/util/0.log" Jul 22 16:01:10.555099 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.555076 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/pull/0.log" Jul 22 16:01:10.561846 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.561824 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/extract/0.log" Jul 22 16:01:10.673076 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.673057 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/util/0.log" Jul 22 16:01:10.679574 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.679558 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/pull/0.log" Jul 22 16:01:10.685758 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.685742 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/extract/0.log" Jul 22 16:01:10.792157 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.792136 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/util/0.log" Jul 22 16:01:10.798763 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.798673 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/pull/0.log" Jul 22 16:01:10.804986 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.804967 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/extract/0.log" Jul 22 16:01:10.914542 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.914515 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/util/0.log" Jul 22 16:01:10.921896 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.921878 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/pull/0.log" Jul 22 16:01:10.928551 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:10.928530 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/extract/0.log" Jul 22 16:01:11.748598 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:11.748564 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9cqkt_b8425659-878b-4909-8520-663c27932ca7/limitador/0.log" Jul 22 16:01:12.345878 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:12.345840 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4zhc_49de927e-93ec-45fb-b75b-4115a8874b3c/discovery/0.log" Jul 22 16:01:13.058851 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:13.058822 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6668855dd4-lktdf_addc21c7-0b9c-4dfb-a58f-f5a25e1bb188/router/0.log" Jul 22 16:01:13.626174 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:13.626136 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lqwc4_9dc5086d-1e0b-44c2-99c3-ac6449865ce8/main/0.log" Jul 22 16:01:13.853264 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:13.853238 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qwdsm_b806a2e1-a850-405e-8548-cbdeb1f3cf51/main/0.log" Jul 22 16:01:19.296401 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:19.296362 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:19.390278 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:19.390246 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:22.414755 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:22.414721 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vh5lj_034c6996-5ef8-4346-b9d1-57d3f994ed05/global-pull-secret-syncer/0.log" Jul 22 16:01:22.468400 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:22.468374 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" Jul 22 16:01:22.608046 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:22.608012 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-36.ec2.internal_22335277600545a94aa18b4597eb4b80/haproxy/0.log" Jul 22 16:01:27.199771 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.199745 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/extract/0.log" Jul 22 16:01:27.226531 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.226510 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/util/0.log" Jul 22 16:01:27.248076 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.248050 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j9zxv_3c83417f-9f31-4c07-8ada-f328548dac6d/pull/0.log" Jul 22 16:01:27.279497 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.279481 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/extract/0.log" Jul 22 16:01:27.303195 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.303177 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/util/0.log" Jul 22 16:01:27.326663 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.326629 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nv6hr_bdb20ff2-3f9c-432e-8da1-e120774c3052/pull/0.log" Jul 22 16:01:27.357476 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.357453 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/extract/0.log" Jul 22 16:01:27.381021 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.381000 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/util/0.log" Jul 22 16:01:27.403316 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.403276 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klg7k_66089b3d-f354-4ac1-a3d7-ce7ec26f4172/pull/0.log" Jul 22 16:01:27.437012 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.436985 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/extract/0.log" Jul 22 16:01:27.460336 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.460276 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/util/0.log" Jul 22 16:01:27.483065 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:27.483032 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvngq_0b013168-8930-49c0-990c-d6a17bddbbeb/pull/0.log" Jul 22 16:01:28.601776 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:28.601738 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9cqkt_b8425659-878b-4909-8520-663c27932ca7/limitador/0.log" Jul 22 16:01:30.515603 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:30.515573 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-q77xk_772076b4-2a6b-460e-ad04-f7fa0cf2be3c/cluster-monitoring-operator/0.log" Jul 22 16:01:30.870368 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:30.870340 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5pjm_aeebc12b-214b-4bb5-a264-73999ba52933/node-exporter/0.log" Jul 22 16:01:30.890796 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:30.890774 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5pjm_aeebc12b-214b-4bb5-a264-73999ba52933/kube-rbac-proxy/0.log" Jul 22 16:01:30.911201 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:30.911178 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5pjm_aeebc12b-214b-4bb5-a264-73999ba52933/init-textfile/0.log" Jul 22 16:01:31.281796 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:31.281730 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866b5cc8cc-hq48r_1668494c-b8b6-4461-9661-3afc6a9f8b8a/telemeter-client/0.log" Jul 22 16:01:31.303860 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:31.303838 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866b5cc8cc-hq48r_1668494c-b8b6-4461-9661-3afc6a9f8b8a/reload/0.log" Jul 22 16:01:31.328369 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:31.328350 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866b5cc8cc-hq48r_1668494c-b8b6-4461-9661-3afc6a9f8b8a/kube-rbac-proxy/0.log" Jul 22 16:01:32.616232 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.616202 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-679vz_b936e7fd-7ba5-4e3b-a8fa-abfd4992e532/networking-console-plugin/0.log" Jul 22 16:01:32.760229 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760194 2542 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst"] Jul 22 16:01:32.760553 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760536 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac812c1-8926-4286-8b47-49e1d31a303d" containerName="maas-api" Jul 22 16:01:32.760656 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760555 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac812c1-8926-4286-8b47-49e1d31a303d" containerName="maas-api" Jul 22 16:01:32.760656 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760574 2542 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75067fbb-c26f-42c7-bce1-9439d26f0905" containerName="maas-api" Jul 22 16:01:32.760656 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760583 2542 state_mem.go:107] "Deleted CPUSet assignment" podUID="75067fbb-c26f-42c7-bce1-9439d26f0905" containerName="maas-api" Jul 22 16:01:32.760817 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760706 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="75067fbb-c26f-42c7-bce1-9439d26f0905" containerName="maas-api" Jul 22 16:01:32.760817 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.760717 2542 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac812c1-8926-4286-8b47-49e1d31a303d" containerName="maas-api" Jul 22 16:01:32.763735 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.763714 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.766032 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.766014 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zkc2l\"/\"kube-root-ca.crt\"" Jul 22 16:01:32.766122 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.766071 2542 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zkc2l\"/\"openshift-service-ca.crt\"" Jul 22 16:01:32.766960 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.766945 2542 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zkc2l\"/\"default-dockercfg-c4rpr\"" Jul 22 16:01:32.774456 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.774434 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst"] Jul 22 16:01:32.821588 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.821566 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-podres\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.821717 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.821594 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-proc\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.821717 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.821616 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-sys\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.821717 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.821666 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-lib-modules\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.821717 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.821693 2542 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgjrg\" (UniqueName: \"kubernetes.io/projected/7850ae85-dbca-4d26-bfb1-82339d846019-kube-api-access-rgjrg\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922802 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922745 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-podres\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922802 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922777 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-proc\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922814 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-sys\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922853 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-lib-modules\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922874 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-proc\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922884 2542 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgjrg\" (UniqueName: \"kubernetes.io/projected/7850ae85-dbca-4d26-bfb1-82339d846019-kube-api-access-rgjrg\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922902 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-podres\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.922962 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922950 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-sys\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.923241 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.922980 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7850ae85-dbca-4d26-bfb1-82339d846019-lib-modules\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:32.931599 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:32.931575 2542 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgjrg\" (UniqueName: \"kubernetes.io/projected/7850ae85-dbca-4d26-bfb1-82339d846019-kube-api-access-rgjrg\") pod \"perf-node-gather-daemonset-pvmst\" (UID: \"7850ae85-dbca-4d26-bfb1-82339d846019\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:33.073552 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.073530 2542 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:33.209664 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.209620 2542 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst"] Jul 22 16:01:33.211358 ip-10-0-136-36 kubenswrapper[2542]: W0722 16:01:33.211318 2542 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7850ae85_dbca_4d26_bfb1_82339d846019.slice/crio-9187b45b27e1b26d65d8aab8b182a602f6311fd3034b504fe904ebc90c1ad1bd WatchSource:0}: Error finding container 9187b45b27e1b26d65d8aab8b182a602f6311fd3034b504fe904ebc90c1ad1bd: Status 404 returned error can't find the container with id 9187b45b27e1b26d65d8aab8b182a602f6311fd3034b504fe904ebc90c1ad1bd Jul 22 16:01:33.402318 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.402274 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" event={"ID":"7850ae85-dbca-4d26-bfb1-82339d846019","Type":"ContainerStarted","Data":"b4876bd29792eee522b5acd56fef7bee598041fb7a8382e35437ee1543512232"} Jul 22 16:01:33.402455 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.402374 2542 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" event={"ID":"7850ae85-dbca-4d26-bfb1-82339d846019","Type":"ContainerStarted","Data":"9187b45b27e1b26d65d8aab8b182a602f6311fd3034b504fe904ebc90c1ad1bd"} Jul 22 16:01:33.402455 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.402398 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:33.420766 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:33.420720 2542 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" podStartSLOduration=1.420705875 podStartE2EDuration="1.420705875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:01:33.418599631 +0000 UTC m=+2923.778681885" watchObservedRunningTime="2026-07-22 16:01:33.420705875 +0000 UTC m=+2923.780788123" Jul 22 16:01:35.631236 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:35.631202 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfmzk_10a7f95b-e941-4f24-a9a3-5ad298f3252d/dns/0.log" Jul 22 16:01:35.651469 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:35.651450 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfmzk_10a7f95b-e941-4f24-a9a3-5ad298f3252d/kube-rbac-proxy/0.log" Jul 22 16:01:35.723310 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:35.723292 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n5lnc_3a7cb4f1-f769-49d9-bf11-bf06d3457ba7/dns-node-resolver/0.log" Jul 22 16:01:36.311061 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:36.311041 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fch8d_2f9cebe6-2201-4395-9989-8bf8a15fddcd/node-ca/0.log" Jul 22 16:01:37.512455 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:37.512427 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4zhc_49de927e-93ec-45fb-b75b-4115a8874b3c/discovery/0.log" Jul 22 16:01:37.779419 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:37.779350 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6668855dd4-lktdf_addc21c7-0b9c-4dfb-a58f-f5a25e1bb188/router/0.log" Jul 22 16:01:38.446652 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:38.446608 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cr7gm_51160b4c-bb34-4a31-99ec-5230c597fc88/serve-healthcheck-canary/0.log" Jul 22 16:01:38.994186 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:38.994158 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-8szf4_f46f5997-06b5-4668-9acb-49d024dc3a12/insights-operator/0.log" Jul 22 16:01:39.016560 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:39.016528 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rsf2_2e29b336-91e6-4afd-b54c-a1bc16a86e89/kube-rbac-proxy/0.log" Jul 22 16:01:39.037572 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:39.037554 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rsf2_2e29b336-91e6-4afd-b54c-a1bc16a86e89/exporter/0.log" Jul 22 16:01:39.059492 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:39.059469 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rsf2_2e29b336-91e6-4afd-b54c-a1bc16a86e89/extractor/0.log" Jul 22 16:01:39.417379 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:39.417356 2542 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pvmst" Jul 22 16:01:42.217557 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:42.217521 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-86wv9_e765079b-f902-46d2-a888-ae7df6f66a24/manager/0.log" Jul 22 16:01:42.243132 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:42.243111 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-86wv9_e765079b-f902-46d2-a888-ae7df6f66a24/copy-manifests/0.log" Jul 22 16:01:43.076841 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:43.076813 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4zhc_49de927e-93ec-45fb-b75b-4115a8874b3c/discovery/0.log" Jul 22 16:01:43.395346 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:43.395322 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6668855dd4-lktdf_addc21c7-0b9c-4dfb-a58f-f5a25e1bb188/router/0.log" Jul 22 16:01:43.824289 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:43.824259 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-947d9d946-xxxmr_1340cd17-5d70-4fcc-be3d-152fd5f1436d/manager/0.log" Jul 22 16:01:43.859259 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:43.859236 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8cvcm_da059464-73d5-4f21-9d5c-cf9b00813038/openshift-lws-operator/0.log" Jul 22 16:01:44.803925 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:44.803842 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4zhc_49de927e-93ec-45fb-b75b-4115a8874b3c/discovery/0.log" Jul 22 16:01:45.001185 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:45.001163 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6668855dd4-lktdf_addc21c7-0b9c-4dfb-a58f-f5a25e1bb188/router/0.log" Jul 22 16:01:45.800152 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:45.800118 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:45.865789 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:45.865755 2542 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8w6q6_7fcb639a-e28d-4254-8630-5c70864f68c2/konnectivity-agent/0.log" limit=1024 Jul 22 16:01:49.123580 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:49.123547 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zkwc6_efe62586-cb4c-4815-8680-0fa68b9d311b/kube-storage-version-migrator-operator/1.log" Jul 22 16:01:49.125258 ip-10-0-136-36 kubenswrapper[2542]: I0722 16:01:49.125230 2542 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zkwc6_efe62586-cb4c-4815-8680-0fa68b9d311b/kube-storage-version-migrator-operator/0.log"