Jul 05 13:18:27.780670 ip-10-0-128-53 systemd[1]: Starting Kubernetes Kubelet... Jul 05 13:18:28.187202 ip-10-0-128-53 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:28.187202 ip-10-0-128-53 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 13:18:28.187202 ip-10-0-128-53 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:28.187202 ip-10-0-128-53 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 13:18:28.187202 ip-10-0-128-53 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:28.188055 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.187969 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196599 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196618 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196622 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196625 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196628 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.196623 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196631 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196634 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196637 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196640 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196643 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196646 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196648 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196651 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196653 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196656 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196659 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196661 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196664 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196674 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196676 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196679 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196682 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196684 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196687 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196691 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.196857 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196695 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196698 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196700 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196703 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196705 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196708 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196710 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196713 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196715 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196718 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196720 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196723 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196725 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196728 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196731 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196734 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196737 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196740 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196743 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196745 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.197361 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196748 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196752 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196755 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196758 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196761 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196764 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196767 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196770 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196773 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196775 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196778 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196780 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196783 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196785 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196788 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196791 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196793 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196796 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196798 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.197867 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196800 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196803 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196806 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196808 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196813 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196817 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196819 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196831 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196834 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196837 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196840 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196842 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196845 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196848 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196851 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196853 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196856 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196858 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196861 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.198326 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196865 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196867 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196870 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196873 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196875 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196878 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196880 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196883 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196886 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196889 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196891 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196895 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196897 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196900 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196902 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.196905 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197620 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197628 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197630 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197633 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.198790 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197636 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197640 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197643 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197645 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197648 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197650 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197653 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197656 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197658 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197661 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197663 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197666 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197668 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197671 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197673 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197676 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197678 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197681 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197683 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197686 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.199280 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197689 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197692 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197694 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197699 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197703 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197706 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197709 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197711 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197714 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197717 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197720 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197722 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197725 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197728 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197730 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197733 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197736 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197738 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197741 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.199778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197743 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197746 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197748 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197751 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197753 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197756 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197758 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197761 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197764 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197767 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197769 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197772 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197775 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197777 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197780 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197782 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197785 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197788 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197790 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197793 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.200258 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197796 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197798 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197801 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197803 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197806 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197809 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197811 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197814 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197816 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197819 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197822 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197824 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197828 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197833 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197836 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197839 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197842 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197845 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197848 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.200750 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197851 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197854 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197858 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197860 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197864 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197867 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197871 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197874 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197877 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197880 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197883 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197886 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197888 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197891 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197894 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197896 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.197900 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198280 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198285 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198288 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.201219 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198291 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198293 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198296 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198299 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198302 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198304 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198307 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198309 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198312 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198315 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198317 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198320 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198323 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198326 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198328 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198331 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198334 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198337 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198339 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198343 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.201729 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198345 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198348 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198351 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198353 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198356 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198358 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198361 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198363 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198366 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198369 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198372 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198375 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198393 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198397 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198402 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198406 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198408 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198411 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198414 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198417 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.202195 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198420 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198423 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198426 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198428 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198431 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198435 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198439 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198442 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198444 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198448 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198452 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198455 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198457 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198460 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198463 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198466 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198469 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198471 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198474 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.202671 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198476 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198481 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198483 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198486 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198488 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198491 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198493 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198496 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198499 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198501 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198503 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198506 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198508 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198511 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198513 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198516 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198519 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198521 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198524 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198526 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.203123 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198530 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198532 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198535 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198537 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198540 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198542 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198546 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198548 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198551 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198553 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198555 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198558 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198560 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198563 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198566 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198568 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.198571 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198643 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198650 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198656 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198661 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 13:18:28.203615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198664 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198668 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198672 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198676 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198679 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198682 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198685 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198688 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198691 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198695 2569 flags.go:64] FLAG: --cgroup-root="" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198697 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198700 2569 flags.go:64] FLAG: --client-ca-file="" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198704 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198707 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198711 2569 flags.go:64] FLAG: --cluster-domain="" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198714 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198717 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198720 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198723 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198727 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198730 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198733 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198736 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198739 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 05 13:18:28.204096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198745 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198748 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198751 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198754 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198758 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198761 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198764 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198767 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198769 2569 flags.go:64] FLAG: --enable-server="true" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198773 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198777 2569 flags.go:64] FLAG: --event-burst="100" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198779 2569 flags.go:64] FLAG: --event-qps="50" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198782 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198785 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198788 2569 flags.go:64] FLAG: --eviction-hard="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198792 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198794 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198798 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198800 2569 flags.go:64] FLAG: --eviction-soft="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198804 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198807 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198810 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198813 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198816 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198819 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 13:18:28.204674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198822 2569 flags.go:64] FLAG: --feature-gates="" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198825 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198828 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198831 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198834 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198837 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198840 2569 flags.go:64] FLAG: --help="false" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198844 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198847 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198850 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198853 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198856 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198860 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198863 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198865 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198868 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198871 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198873 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198877 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198879 2569 flags.go:64] FLAG: --kube-reserved="" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198882 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198885 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198888 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198891 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 13:18:28.205334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198894 2569 flags.go:64] FLAG: --lock-file="" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198896 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198899 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198902 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198907 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198911 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198914 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198917 2569 flags.go:64] FLAG: --logging-format="text" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198920 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198923 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198926 2569 flags.go:64] FLAG: --manifest-url="" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198929 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198933 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198936 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198939 2569 flags.go:64] FLAG: --max-pods="110" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198944 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198947 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198949 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198952 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198955 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198958 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198961 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198968 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198971 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198974 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 13:18:28.205918 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198977 2569 flags.go:64] FLAG: --pod-cidr="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198980 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198985 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198987 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198991 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198993 2569 flags.go:64] FLAG: --port="10250" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.198997 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199000 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-001120a5c4580581c" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199003 2569 flags.go:64] FLAG: --qos-reserved="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199006 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199009 2569 flags.go:64] FLAG: --register-node="true" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199011 2569 flags.go:64] FLAG: --register-with-taints="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199015 2569 flags.go:64] FLAG: --registry-burst="10" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199018 2569 flags.go:64] FLAG: --registry-qps="5" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199021 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199023 2569 flags.go:64] FLAG: --reserved-memory="" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199027 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199030 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199033 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199036 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199038 2569 flags.go:64] FLAG: --runonce="false" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199041 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199044 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199048 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199051 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 13:18:28.206538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199053 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199056 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199059 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199062 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199065 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199068 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199070 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199073 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199076 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199079 2569 flags.go:64] FLAG: --system-cgroups="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199081 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199090 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199094 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199096 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199101 2569 flags.go:64] FLAG: --tls-min-version="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199103 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199106 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199109 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199112 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199115 2569 flags.go:64] FLAG: --v="2" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199119 2569 flags.go:64] FLAG: --version="false" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199123 2569 flags.go:64] FLAG: --vmodule="" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199127 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.199130 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199265 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.207128 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199269 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199273 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199276 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199278 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199281 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199285 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199288 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199291 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199294 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199296 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199299 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199301 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199304 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199306 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199309 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199311 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199314 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199317 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199321 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199323 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.207736 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199326 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199328 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199331 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199334 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199336 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199339 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199341 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199344 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199347 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199355 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199358 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199360 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199363 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199366 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199368 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199371 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199373 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199377 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199398 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.208212 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199401 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199404 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199407 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199409 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199412 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199415 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199417 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199420 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199423 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199425 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199428 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199432 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199435 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199437 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199440 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199442 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199445 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199447 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199450 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199452 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.208739 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199455 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199457 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199461 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199465 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199468 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199471 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199474 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199477 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199479 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199482 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199485 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199488 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199490 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199493 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199496 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199499 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199501 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199504 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199506 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199509 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.209255 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199512 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199515 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199517 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199521 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199525 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199529 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199531 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199534 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199537 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199539 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199542 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199545 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199548 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199552 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199555 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199558 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199562 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199565 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.209749 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.199567 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.200166 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.206639 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.206658 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.206682 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.206690 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206752 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206757 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206761 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206764 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206767 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206769 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206772 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206775 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206778 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.210187 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206781 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206783 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206786 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206788 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206792 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206796 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206798 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206801 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206804 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206806 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206809 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206812 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206815 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206817 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206820 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206823 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206826 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206828 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206831 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.210563 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206834 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206838 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206840 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206843 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206846 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206848 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206851 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206854 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206856 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206859 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206862 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206864 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206867 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206869 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206872 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206875 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206877 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206880 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206882 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.211009 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206885 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206887 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206890 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206892 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206895 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206898 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206900 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206903 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206905 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206908 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206911 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206913 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206916 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206918 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206921 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206924 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206928 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206931 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206934 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.211472 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206937 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206940 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206942 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206945 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206948 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206950 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206954 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206957 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206960 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206963 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206966 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206968 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206971 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206973 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206976 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206978 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206981 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206983 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206986 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206990 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.211916 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206992 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206995 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.206997 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207000 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207004 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207006 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207009 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207012 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207014 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207017 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207020 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207022 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207024 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.207029 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207143 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:28.212399 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207147 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207150 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207153 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207157 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207159 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207162 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207165 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207168 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207170 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207173 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207176 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207178 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207181 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207183 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207186 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207189 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207191 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207194 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207196 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207199 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:28.212770 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207202 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207204 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207207 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207209 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207212 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207214 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207217 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207219 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207222 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207224 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207227 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207229 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207232 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207234 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207236 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207239 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207242 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207244 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207248 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:28.213250 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207251 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207253 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207256 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207258 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207261 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207263 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207265 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207268 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207271 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207273 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207276 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207278 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207281 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207283 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207285 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207288 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207291 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207294 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207296 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207299 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:28.213799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207301 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207304 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207306 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207309 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207311 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207314 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207316 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207319 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207321 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207325 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207328 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207331 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207334 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207337 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207339 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207342 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207344 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207348 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207351 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:28.214261 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207354 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207356 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207359 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207362 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207364 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207367 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207369 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207373 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207375 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207393 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207398 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207401 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207403 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207406 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207409 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207411 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207414 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207416 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207419 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:28.214740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:28.207421 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.207426 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.207531 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.209336 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.211076 2569 server.go:1019] "Starting client certificate rotation" Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.211171 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.211202 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:28.215187 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.213413 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:28.215812 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.215796 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:28.229039 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.229022 2569 log.go:25] "Validated CRI v1 runtime API" Jul 05 13:18:28.232354 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.232340 2569 log.go:25] "Validated CRI v1 image API" Jul 05 13:18:28.233257 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.233240 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 13:18:28.236427 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.236408 2569 fs.go:135] Filesystem UUIDs: map[3bdb9841-12e8-44f3-9bdd-3b7ab02199d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 997addf0-c6d6-4555-824d-2083993b0705:/dev/nvme0n1p3] Jul 05 13:18:28.236501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.236425 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 13:18:28.237494 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.237472 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:28.242397 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.242286 2569 manager.go:216] Machine: {Timestamp:2026-07-05 13:18:28.240919282 +0000 UTC m=+0.321834658 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108156 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5a8ebd277439407e119c289d0586 SystemUUID:ec2e5a8e-bd27-7439-407e-119c289d0586 BootID:fa183b87-551b-4913-aee9-75d12f45a006 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:75:d1:95:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:75:d1:95:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e8:eb:94:94:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 13:18:28.242397 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.242390 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 13:18:28.242510 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.242490 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 13:18:28.244654 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.244628 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 13:18:28.244784 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.244656 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 13:18:28.246405 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.246394 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 13:18:28.246438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.246407 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 13:18:28.246438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.246414 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:28.246993 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.246983 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:28.248147 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.248138 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 13:18:28.250722 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250711 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:28.250840 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250830 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 13:18:28.250877 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250868 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 05 13:18:28.250914 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250893 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 13:18:28.250965 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250916 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 13:18:28.250965 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250929 2569 kubelet.go:398] "Adding apiserver pod source" Jul 05 13:18:28.250965 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.250941 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 13:18:28.251328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.251305 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:28.251328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.251323 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:28.253450 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.253434 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 13:18:28.255122 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.255102 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 13:18:28.255200 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.255148 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 13:18:28.256081 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256069 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 13:18:28.256129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256086 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 13:18:28.256129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256092 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 13:18:28.256129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256099 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 13:18:28.256129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256107 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 13:18:28.256129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256113 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 13:18:28.256262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256237 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 13:18:28.256262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256242 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 13:18:28.256262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256249 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 13:18:28.256262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256254 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 13:18:28.256396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256267 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 13:18:28.256396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256275 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 13:18:28.256396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256297 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 13:18:28.256396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.256302 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 13:18:28.259574 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.259552 2569 server.go:1268] "Started kubelet" Jul 05 13:18:28.260191 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.259715 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 13:18:28.260191 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.259789 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 13:18:28.260191 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.259830 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 13:18:28.260309 ip-10-0-128-53 systemd[1]: Started Kubernetes Kubelet. Jul 05 13:18:28.261850 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.261829 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 13:18:28.262338 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.262325 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 05 13:18:28.264155 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.264115 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 13:18:28.264787 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.264770 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nwbhn" Jul 05 13:18:28.265431 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.265412 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 13:18:28.265516 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.265454 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 13:18:28.265516 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.265481 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 13:18:28.266451 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.265487 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-53.ec2.internal.18bf674172db65b4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-53.ec2.internal,UID:ip-10-0-128-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-53.ec2.internal,},FirstTimestamp:2026-07-05 13:18:28.259521972 +0000 UTC m=+0.340437352,LastTimestamp:2026-07-05 13:18:28.259521972 +0000 UTC m=+0.340437352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-53.ec2.internal,}" Jul 05 13:18:28.267262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267245 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 13:18:28.267262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267257 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:28.267361 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.267340 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.267838 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267820 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 13:18:28.267838 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267836 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 13:18:28.267986 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267852 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 13:18:28.268041 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.267992 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 05 13:18:28.268041 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268000 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 05 13:18:28.268127 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268078 2569 factory.go:55] Registering systemd factory Jul 05 13:18:28.268127 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268091 2569 factory.go:223] Registration of the systemd container factory successfully Jul 05 13:18:28.268401 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268368 2569 factory.go:153] Registering CRI-O factory Jul 05 13:18:28.268401 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268399 2569 factory.go:223] Registration of the crio container factory successfully Jul 05 13:18:28.268551 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268446 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 13:18:28.268551 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268469 2569 factory.go:103] Registering Raw factory Jul 05 13:18:28.268551 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268482 2569 manager.go:1196] Started watching for new ooms in manager Jul 05 13:18:28.268876 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.268863 2569 manager.go:349] Starting recovery of all containers Jul 05 13:18:28.272193 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.272150 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 05 13:18:28.272319 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.272291 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 05 13:18:28.278552 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.278527 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nwbhn" Jul 05 13:18:28.278698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.278685 2569 manager.go:354] Recovery completed Jul 05 13:18:28.283274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.283262 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.284940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.284920 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.285008 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.284955 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.285008 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.284972 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.286423 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.286373 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.286544 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.286376 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 13:18:28.286638 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.286625 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 13:18:28.286693 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.286648 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:28.287201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.287186 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.287275 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.287211 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.287275 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.287223 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.287634 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.287621 2569 policy_none.go:49] "None policy: Start" Jul 05 13:18:28.287683 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.287569 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-53.ec2.internal.18bf6741745f3cd0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-53.ec2.internal,UID:ip-10-0-128-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-53.ec2.internal,},FirstTimestamp:2026-07-05 13:18:28.284939472 +0000 UTC m=+0.365854857,LastTimestamp:2026-07-05 13:18:28.284939472 +0000 UTC m=+0.365854857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-53.ec2.internal,}" Jul 05 13:18:28.288013 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.288001 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 13:18:28.288060 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.288029 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 13:18:28.289159 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.289146 2569 policy_none.go:47] "Start" Jul 05 13:18:28.333103 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.332926 2569 manager.go:337] "Starting Device Plugin manager" Jul 05 13:18:28.333218 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.333137 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 13:18:28.333218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333152 2569 server.go:87] "Starting device plugin registration server" Jul 05 13:18:28.333393 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333369 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 13:18:28.333431 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333396 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 13:18:28.333509 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333489 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 13:18:28.333592 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333580 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 13:18:28.333592 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.333592 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 13:18:28.334780 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.334764 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 13:18:28.334848 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.334807 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.406866 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.406827 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 13:18:28.408147 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.408131 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 13:18:28.408229 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.408166 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 13:18:28.408229 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.408194 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 13:18:28.408311 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.408242 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 13:18:28.410990 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.410966 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:28.434203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.434183 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.435056 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.435039 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.435134 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.435076 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.435134 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.435088 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.435134 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.435112 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.444300 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.444248 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.444300 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.444277 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-53.ec2.internal\": node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.460173 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.460154 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.508453 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.508421 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"] Jul 05 13:18:28.508541 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.508490 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.509311 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.509296 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.509359 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.509322 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.509359 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.509331 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.510428 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.510416 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.510536 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.510523 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.510588 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.510558 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.511029 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511014 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.511088 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511014 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.511088 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511066 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.511088 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511078 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.511166 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511041 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.511166 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.511113 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.512046 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.512032 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.512097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.512057 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:28.512691 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.512678 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:28.512768 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.512701 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:28.512768 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.512711 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:28.527875 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.527859 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-53.ec2.internal\" not found" node="ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.531445 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.531430 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-53.ec2.internal\" not found" node="ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.560218 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.560190 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.569469 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.569452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.569523 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.569473 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.569523 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.569491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.660835 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.660807 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.670103 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.670149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.670149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.670206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670161 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.670206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670187 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.670261 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.670187 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.761525 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.761468 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.830874 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.830841 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.834233 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:28.834215 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:28.862346 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.862322 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:28.962790 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:28.962742 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.063235 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.063160 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.163584 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.163554 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.209943 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.209921 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 13:18:29.210364 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.210057 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:29.264309 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.264277 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.279852 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:29.279817 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da60c6aa145a773b0c59de51f12d9f6.slice/crio-3a9575bdc9b601fb437bf811b98d398c78e68ec52e49efa1f19626117cfaeb84 WatchSource:0}: Error finding container 3a9575bdc9b601fb437bf811b98d398c78e68ec52e49efa1f19626117cfaeb84: Status 404 returned error can't find the container with id 3a9575bdc9b601fb437bf811b98d398c78e68ec52e49efa1f19626117cfaeb84 Jul 05 13:18:29.280133 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:29.280120 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bce2051af4a6b9f223b5c48fe134dc.slice/crio-d1beb3782527db5bb5245857e36d2e4e5d7c89544e28d658383d6562d0cc3a64 WatchSource:0}: Error finding container d1beb3782527db5bb5245857e36d2e4e5d7c89544e28d658383d6562d0cc3a64: Status 404 returned error can't find the container with id d1beb3782527db5bb5245857e36d2e4e5d7c89544e28d658383d6562d0cc3a64 Jul 05 13:18:29.282189 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.282155 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:13:28 +0000 UTC" deadline="2028-02-06 20:18:07.419214084 +0000 UTC" Jul 05 13:18:29.282189 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.282189 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13950h59m38.137029411s" Jul 05 13:18:29.283203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.283184 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:18:29.364564 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.364480 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.400603 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.400583 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:29.411962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.411925 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerStarted","Data":"d1beb3782527db5bb5245857e36d2e4e5d7c89544e28d658383d6562d0cc3a64"} Jul 05 13:18:29.412915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.412895 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" event={"ID":"6da60c6aa145a773b0c59de51f12d9f6","Type":"ContainerStarted","Data":"3a9575bdc9b601fb437bf811b98d398c78e68ec52e49efa1f19626117cfaeb84"} Jul 05 13:18:29.465091 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.465072 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.496802 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.496780 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:29.566180 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:29.566141 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found" Jul 05 13:18:29.622634 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.622570 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:29.667584 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.667393 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" Jul 05 13:18:29.679715 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.679682 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:29.680539 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.680515 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" Jul 05 13:18:29.690997 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:29.690967 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:30.251333 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.251299 2569 apiserver.go:52] "Watching apiserver" Jul 05 13:18:30.260205 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.260171 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 13:18:30.260628 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.260598 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rgr2m","openshift-network-diagnostics/network-check-target-xpht5","openshift-ovn-kubernetes/ovnkube-node-42l6d","kube-system/global-pull-secret-syncer-bhr8d","kube-system/konnectivity-agent-6hlfp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx","openshift-dns/node-resolver-xkf7k","openshift-image-registry/node-ca-f8hhr","openshift-multus/multus-additional-cni-plugins-z2tqc","openshift-network-operator/iptables-alerter-l6xbw","kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7m8cw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal","openshift-multus/multus-8zk6j"] Jul 05 13:18:30.261894 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.261871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.263213 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.263193 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.265781 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.264552 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5828\"" Jul 05 13:18:30.265781 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.264661 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.265781 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.264665 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.266186 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.266161 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.266289 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.266187 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 13:18:30.266349 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.266312 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sw6cd\"" Jul 05 13:18:30.266642 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.266620 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.267220 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.267202 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.268230 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.268211 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:30.268482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.268455 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.268574 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.268518 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:30.269560 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.269515 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.270064 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.270016 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 13:18:30.270150 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.270093 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.270287 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.270262 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.270849 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.270830 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.271193 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271147 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 13:18:30.271193 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271161 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 13:18:30.271336 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271198 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hhpx6\"" Jul 05 13:18:30.271336 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271302 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 13:18:30.271896 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271855 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d6dmn\"" Jul 05 13:18:30.271998 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.271964 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 13:18:30.272578 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.272138 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 13:18:30.272578 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.272409 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.273203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.273187 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nt6j6\"" Jul 05 13:18:30.273411 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.273395 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.273612 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.273596 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.273700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.273686 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 13:18:30.274000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.273985 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.274099 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.274058 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.274904 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.274927 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.274958 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.275051 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.274968 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 13:18:30.275218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.275183 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 13:18:30.275562 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.275458 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2g7q2\"" Jul 05 13:18:30.275614 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.275594 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.276227 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.276208 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.277570 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.277551 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.278403 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278367 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-log-socket\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-config\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278439 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-script-lib\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278479 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-etc-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278661 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278527 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-node-log\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278661 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-netd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278661 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb639378-efc6-4433-b34e-700b3bf58d6b-tmp-dir\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.278661 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-systemd-units\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278689 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278692 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-bin\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-kubelet-config\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-var-lib-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.278848 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278834 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp8h2\" (UniqueName: \"kubernetes.io/projected/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-kube-api-access-xp8h2\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-systemd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278922 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfbm5\" (UniqueName: \"kubernetes.io/projected/cb639378-efc6-4433-b34e-700b3bf58d6b-kube-api-access-tfbm5\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86065ff3-869e-4ac7-be22-99c66b70f51a-serviceca\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.278973 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-kubelet\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279007 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279003 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-slash\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-ovn\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279069 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gv9ch\"" Jul 05 13:18:30.279161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279107 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86065ff3-869e-4ac7-be22-99c66b70f51a-host\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279235 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbwhh\" (UniqueName: \"kubernetes.io/projected/86065ff3-869e-4ac7-be22-99c66b70f51a-kube-api-access-cbwhh\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-netns\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279309 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-dbus\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-env-overrides\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279355 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovn-node-metrics-cert\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.279615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb639378-efc6-4433-b34e-700b3bf58d6b-hosts-file\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.279973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279727 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 13:18:30.279973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.279874 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r77d2\"" Jul 05 13:18:30.281132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.281113 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:30.281567 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.281548 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v9wqg\"" Jul 05 13:18:30.281687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.281602 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:30.281687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.281554 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:30.313037 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.313000 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-29jvd" Jul 05 13:18:30.318626 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.318604 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-29jvd" Jul 05 13:18:30.369106 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.369082 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 13:18:30.380514 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-kubernetes\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-lib-modules\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380553 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-netd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.380656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380608 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-netd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.380656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380609 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.380656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-host-slash\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-tuned\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb639378-efc6-4433-b34e-700b3bf58d6b-tmp-dir\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-konnectivity-ca\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380754 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysconfig\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-etc-kubernetes\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380830 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-run\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-sys\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-multus\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380884 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.380899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm6pq\" (UniqueName: \"kubernetes.io/projected/6fbfa86c-c677-4091-901f-c936a865545b-kube-api-access-rm6pq\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380933 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.380964 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jkc\" (UniqueName: \"kubernetes.io/projected/9ff50a7e-13d6-4fc4-954d-0a7051d32608-kube-api-access-24jkc\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381012 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-ovn\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381044 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb639378-efc6-4433-b34e-700b3bf58d6b-tmp-dir\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-agent-certs\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381092 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-ovn\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381106 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-cnibin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-kubelet\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-systemd\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381181 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86065ff3-869e-4ac7-be22-99c66b70f51a-host\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381207 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbwhh\" (UniqueName: \"kubernetes.io/projected/86065ff3-869e-4ac7-be22-99c66b70f51a-kube-api-access-cbwhh\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381231 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-netns\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381243 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86065ff3-869e-4ac7-be22-99c66b70f51a-host\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-dbus\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.381420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381340 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-system-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381360 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovn-node-metrics-cert\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-os-release\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-k8s-cni-cncf-io\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381451 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-multus-certs\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381472 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381529 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-host\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381551 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb639378-efc6-4433-b34e-700b3bf58d6b-hosts-file\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381604 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-netns\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-netns\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381632 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb639378-efc6-4433-b34e-700b3bf58d6b-hosts-file\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381665 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-multus-daemon-config\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-config\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-script-lib\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381777 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-dbus\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-etc-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.382264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381813 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381833 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-node-log\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381855 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381893 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-etc-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-iptables-alerter-script\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381953 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-node-log\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.381989 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-systemd-units\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382051 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-bin\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382083 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-run-ovn-kubernetes\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382111 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-systemd-units\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382126 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-kubelet-config\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382142 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-cni-bin\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-cnibin\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382206 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b657fe4-b60c-4298-b201-3a6d10bb345b-kubelet-config\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382260 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-socket-dir-parent\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.383125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382297 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-bin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382330 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-script-lib\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382349 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-var-lib-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382352 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovnkube-config\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp8h2\" (UniqueName: \"kubernetes.io/projected/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-kube-api-access-xp8h2\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382424 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-var-lib-openvswitch\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382437 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n66j9\" (UniqueName: \"kubernetes.io/projected/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-kube-api-access-n66j9\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382453 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-modprobe-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-tmp\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8fl\" (UniqueName: \"kubernetes.io/projected/70910fbb-7807-4042-afbb-9b6fb9bce39e-kube-api-access-bf8fl\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-systemd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382589 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-run-systemd\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382591 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9c2g\" (UniqueName: \"kubernetes.io/projected/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kube-api-access-r9c2g\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-var-lib-kubelet\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfbm5\" (UniqueName: \"kubernetes.io/projected/cb639378-efc6-4433-b34e-700b3bf58d6b-kube-api-access-tfbm5\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86065ff3-869e-4ac7-be22-99c66b70f51a-serviceca\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.383915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-kubelet\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382713 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-slash\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382733 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382753 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-device-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-cni-binary-copy\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382792 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-socket-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-registration-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-os-release\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382855 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-hostroot\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382873 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-conf\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382894 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-env-overrides\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382916 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.382916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-kubelet\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.383011 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-sys-fs\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.383120 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86065ff3-869e-4ac7-be22-99c66b70f51a-serviceca\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.383721 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-host-slash\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.384605 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.383812 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.383890 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:30.88385823 +0000 UTC m=+2.964773616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-log-socket\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384307 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384350 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-log-socket\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384411 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-env-overrides\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384457 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwf4r\" (UniqueName: \"kubernetes.io/projected/de730594-936e-4685-80bb-c2982023ac1c-kube-api-access-lwf4r\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.385140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.384492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-conf-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.385973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.385954 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-ovn-node-metrics-cert\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.395800 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.395776 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbwhh\" (UniqueName: \"kubernetes.io/projected/86065ff3-869e-4ac7-be22-99c66b70f51a-kube-api-access-cbwhh\") pod \"node-ca-f8hhr\" (UID: \"86065ff3-869e-4ac7-be22-99c66b70f51a\") " pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.396719 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.396693 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfbm5\" (UniqueName: \"kubernetes.io/projected/cb639378-efc6-4433-b34e-700b3bf58d6b-kube-api-access-tfbm5\") pod \"node-resolver-xkf7k\" (UID: \"cb639378-efc6-4433-b34e-700b3bf58d6b\") " pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.396806 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.396707 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp8h2\" (UniqueName: \"kubernetes.io/projected/dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18-kube-api-access-xp8h2\") pod \"ovnkube-node-42l6d\" (UID: \"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18\") " pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.410120 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.410102 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.485814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm6pq\" (UniqueName: \"kubernetes.io/projected/6fbfa86c-c677-4091-901f-c936a865545b-kube-api-access-rm6pq\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.485924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.485993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jkc\" (UniqueName: \"kubernetes.io/projected/9ff50a7e-13d6-4fc4-954d-0a7051d32608-kube-api-access-24jkc\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486032 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-agent-certs\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-cnibin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-kubelet\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-systemd\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486498 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-etc-selinux\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-cnibin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486667 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-kubelet\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486727 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-systemd\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486767 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-system-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486799 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-os-release\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486874 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.489513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486890 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-k8s-cni-cncf-io\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486933 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-multus-certs\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486943 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-k8s-cni-cncf-io\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.486998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-host\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-os-release\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487032 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-netns\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487058 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-multus-daemon-config\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487067 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-multus-certs\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487121 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-system-cni-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487140 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-iptables-alerter-script\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487170 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-run-netns\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-cnibin\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487250 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-socket-dir-parent\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487279 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-bin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.490457 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n66j9\" (UniqueName: \"kubernetes.io/projected/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-kube-api-access-n66j9\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-modprobe-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487433 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-tmp\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8fl\" (UniqueName: \"kubernetes.io/projected/70910fbb-7807-4042-afbb-9b6fb9bce39e-kube-api-access-bf8fl\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9c2g\" (UniqueName: \"kubernetes.io/projected/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kube-api-access-r9c2g\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-var-lib-kubelet\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-device-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487639 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-cni-binary-copy\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-socket-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487713 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-registration-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-os-release\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-hostroot\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487824 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-iptables-alerter-script\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.487916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-cnibin\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488082 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.491182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488157 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-socket-dir-parent\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488221 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-bin\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488260 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-host\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488320 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-multus-daemon-config\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.488330 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488374 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-conf\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.488432 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:30.988417802 +0000 UTC m=+3.069333165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-sys-fs\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488486 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488546 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysctl-conf\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488823 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488886 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-device-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488961 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.488998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwf4r\" (UniqueName: \"kubernetes.io/projected/de730594-936e-4685-80bb-c2982023ac1c-kube-api-access-lwf4r\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.489207 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-agent-certs\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.489687 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-var-lib-kubelet\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.489771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-hostroot\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.489815 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-modprobe-d\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.490228 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-socket-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.490240 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-registration-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.490874 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbfa86c-c677-4091-901f-c936a865545b-cni-binary-copy\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.490907 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de730594-936e-4685-80bb-c2982023ac1c-os-release\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-conf-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-kubernetes\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491180 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-lib-modules\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491202 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491207 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-sys-fs\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491232 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-host-slash\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-tuned\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491267 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-konnectivity-ca\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491347 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysconfig\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491371 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-etc-kubernetes\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491372 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-host-slash\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.492825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-run\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491445 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-kubernetes\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-sys\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491490 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-multus\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491506 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-sys\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491261 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-multus-conf-dir\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491549 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-host-var-lib-cni-multus\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491736 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.491964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-lib-modules\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.492022 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a-konnectivity-ca\") pod \"konnectivity-agent-6hlfp\" (UID: \"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a\") " pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.492024 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbfa86c-c677-4091-901f-c936a865545b-etc-kubernetes\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.492070 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-sysconfig\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.492096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70910fbb-7807-4042-afbb-9b6fb9bce39e-run\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.493421 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.492530 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de730594-936e-4685-80bb-c2982023ac1c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.494311 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.494279 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-tmp\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.494433 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.494411 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm6pq\" (UniqueName: \"kubernetes.io/projected/6fbfa86c-c677-4091-901f-c936a865545b-kube-api-access-rm6pq\") pod \"multus-8zk6j\" (UID: \"6fbfa86c-c677-4091-901f-c936a865545b\") " pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.494652 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.494636 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70910fbb-7807-4042-afbb-9b6fb9bce39e-etc-tuned\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.500363 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.500341 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:30.500363 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.500364 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:30.500535 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.500391 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:30.500535 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.500459 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.000441786 +0000 UTC m=+3.081357168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:30.502597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.502536 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jkc\" (UniqueName: \"kubernetes.io/projected/9ff50a7e-13d6-4fc4-954d-0a7051d32608-kube-api-access-24jkc\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.502703 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.502638 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8fl\" (UniqueName: \"kubernetes.io/projected/70910fbb-7807-4042-afbb-9b6fb9bce39e-kube-api-access-bf8fl\") pod \"tuned-7m8cw\" (UID: \"70910fbb-7807-4042-afbb-9b6fb9bce39e\") " pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.503423 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.503406 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwf4r\" (UniqueName: \"kubernetes.io/projected/de730594-936e-4685-80bb-c2982023ac1c-kube-api-access-lwf4r\") pod \"multus-additional-cni-plugins-z2tqc\" (UID: \"de730594-936e-4685-80bb-c2982023ac1c\") " pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.503682 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.503659 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n66j9\" (UniqueName: \"kubernetes.io/projected/0b70827d-c69f-4d5d-b7ac-57d9b81f498f-kube-api-access-n66j9\") pod \"iptables-alerter-l6xbw\" (UID: \"0b70827d-c69f-4d5d-b7ac-57d9b81f498f\") " pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.503752 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.503736 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9c2g\" (UniqueName: \"kubernetes.io/projected/4658f72c-7537-4a8e-9f17-9f6c6c2bd3be-kube-api-access-r9c2g\") pod \"aws-ebs-csi-driver-node-lb9dx\" (UID: \"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.576060 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.576028 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkf7k" Jul 05 13:18:30.583552 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.583525 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f8hhr" Jul 05 13:18:30.592316 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.592294 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:30.598257 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.598236 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:30.605096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.605074 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" Jul 05 13:18:30.614704 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.614686 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" Jul 05 13:18:30.622819 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.622799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6xbw" Jul 05 13:18:30.629748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.629730 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zk6j" Jul 05 13:18:30.634687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.634670 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" Jul 05 13:18:30.894494 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.894465 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:30.894670 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.894594 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:30.894670 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.894669 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.894647045 +0000 UTC m=+3.975562431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:30.995866 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:30.995833 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:30.996047 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.995970 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:30.996101 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:30.996048 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.9960266 +0000 UTC m=+4.076941964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:31.055898 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.055760 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e637ff0_ca63_40ef_b4cf_4dc07ade5c6a.slice/crio-d6a7b94b2205cf12c9b860b78cde94798be46843b00b1807cdf7da3a7d01d9b6 WatchSource:0}: Error finding container d6a7b94b2205cf12c9b860b78cde94798be46843b00b1807cdf7da3a7d01d9b6: Status 404 returned error can't find the container with id d6a7b94b2205cf12c9b860b78cde94798be46843b00b1807cdf7da3a7d01d9b6 Jul 05 13:18:31.057557 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.057534 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9dcf19_3522_4ad0_88bf_3cf51f4c3f18.slice/crio-b3f750115cbb13258d16101bd2f3c89622e38ec35928998eb88f936b2dc9522d WatchSource:0}: Error finding container b3f750115cbb13258d16101bd2f3c89622e38ec35928998eb88f936b2dc9522d: Status 404 returned error can't find the container with id b3f750115cbb13258d16101bd2f3c89622e38ec35928998eb88f936b2dc9522d Jul 05 13:18:31.059242 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.059196 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70910fbb_7807_4042_afbb_9b6fb9bce39e.slice/crio-1e676a9f200fbcc535c3f1e699913c97fde3aea3400c25a3478a82337578d563 WatchSource:0}: Error finding container 1e676a9f200fbcc535c3f1e699913c97fde3aea3400c25a3478a82337578d563: Status 404 returned error can't find the container with id 1e676a9f200fbcc535c3f1e699913c97fde3aea3400c25a3478a82337578d563 Jul 05 13:18:31.061969 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.061936 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde730594_936e_4685_80bb_c2982023ac1c.slice/crio-c0316f443add4ff5c5ea09bd9eebe4473199e94935a9ab36604fac5e77565471 WatchSource:0}: Error finding container c0316f443add4ff5c5ea09bd9eebe4473199e94935a9ab36604fac5e77565471: Status 404 returned error can't find the container with id c0316f443add4ff5c5ea09bd9eebe4473199e94935a9ab36604fac5e77565471 Jul 05 13:18:31.062806 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.062723 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b70827d_c69f_4d5d_b7ac_57d9b81f498f.slice/crio-c697f18adab64be080e331c19d9169aa15086cdb15b239ddb35fdf1fa3526f11 WatchSource:0}: Error finding container c697f18adab64be080e331c19d9169aa15086cdb15b239ddb35fdf1fa3526f11: Status 404 returned error can't find the container with id c697f18adab64be080e331c19d9169aa15086cdb15b239ddb35fdf1fa3526f11 Jul 05 13:18:31.063785 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.063681 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbfa86c_c677_4091_901f_c936a865545b.slice/crio-16c0d0ac94732c0b197933f9800da4f4d44a4d2b2271cce11cb2f79591f9bf92 WatchSource:0}: Error finding container 16c0d0ac94732c0b197933f9800da4f4d44a4d2b2271cce11cb2f79591f9bf92: Status 404 returned error can't find the container with id 16c0d0ac94732c0b197933f9800da4f4d44a4d2b2271cce11cb2f79591f9bf92 Jul 05 13:18:31.064564 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.064544 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4658f72c_7537_4a8e_9f17_9f6c6c2bd3be.slice/crio-45f6a99ee5db2e4ea0fd596ee32eafef02ac41c421f98d1547e6e93d97ee2ae5 WatchSource:0}: Error finding container 45f6a99ee5db2e4ea0fd596ee32eafef02ac41c421f98d1547e6e93d97ee2ae5: Status 404 returned error can't find the container with id 45f6a99ee5db2e4ea0fd596ee32eafef02ac41c421f98d1547e6e93d97ee2ae5 Jul 05 13:18:31.065924 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.065861 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb639378_efc6_4433_b34e_700b3bf58d6b.slice/crio-45ef10eb9773c540d0c85a48fe0056757fee12a85b57af628b9b6a5541c02895 WatchSource:0}: Error finding container 45ef10eb9773c540d0c85a48fe0056757fee12a85b57af628b9b6a5541c02895: Status 404 returned error can't find the container with id 45ef10eb9773c540d0c85a48fe0056757fee12a85b57af628b9b6a5541c02895 Jul 05 13:18:31.067006 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:18:31.066638 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86065ff3_869e_4ac7_be22_99c66b70f51a.slice/crio-2de9b75957b7d01daa8df7688ac2190fddbc72617d20a731c0930c3bc4d14a23 WatchSource:0}: Error finding container 2de9b75957b7d01daa8df7688ac2190fddbc72617d20a731c0930c3bc4d14a23: Status 404 returned error can't find the container with id 2de9b75957b7d01daa8df7688ac2190fddbc72617d20a731c0930c3bc4d14a23 Jul 05 13:18:31.096111 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.096083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:31.096246 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.096225 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:31.096286 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.096258 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:31.096286 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.096271 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:31.096367 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.096325 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:32.096306046 +0000 UTC m=+4.177221428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:31.320991 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.320824 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:30 +0000 UTC" deadline="2028-01-07 08:27:28.699577818 +0000 UTC" Jul 05 13:18:31.320991 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.320990 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13219h8m57.378591828s" Jul 05 13:18:31.408441 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.408407 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:31.408598 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.408540 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:31.416978 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.416945 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6xbw" event={"ID":"0b70827d-c69f-4d5d-b7ac-57d9b81f498f","Type":"ContainerStarted","Data":"c697f18adab64be080e331c19d9169aa15086cdb15b239ddb35fdf1fa3526f11"} Jul 05 13:18:31.418261 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.418235 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerStarted","Data":"c0316f443add4ff5c5ea09bd9eebe4473199e94935a9ab36604fac5e77565471"} Jul 05 13:18:31.420159 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.420137 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" event={"ID":"6da60c6aa145a773b0c59de51f12d9f6","Type":"ContainerStarted","Data":"b4ebcffc3921c12925744f8890bbce2d3eddaf27387b1c49ecc986c3091a19de"} Jul 05 13:18:31.421520 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.421486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkf7k" event={"ID":"cb639378-efc6-4433-b34e-700b3bf58d6b","Type":"ContainerStarted","Data":"45ef10eb9773c540d0c85a48fe0056757fee12a85b57af628b9b6a5541c02895"} Jul 05 13:18:31.422852 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.422784 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" event={"ID":"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be","Type":"ContainerStarted","Data":"45f6a99ee5db2e4ea0fd596ee32eafef02ac41c421f98d1547e6e93d97ee2ae5"} Jul 05 13:18:31.423975 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.423952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zk6j" event={"ID":"6fbfa86c-c677-4091-901f-c936a865545b","Type":"ContainerStarted","Data":"16c0d0ac94732c0b197933f9800da4f4d44a4d2b2271cce11cb2f79591f9bf92"} Jul 05 13:18:31.425100 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.425075 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" event={"ID":"70910fbb-7807-4042-afbb-9b6fb9bce39e","Type":"ContainerStarted","Data":"1e676a9f200fbcc535c3f1e699913c97fde3aea3400c25a3478a82337578d563"} Jul 05 13:18:31.426406 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.426341 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"b3f750115cbb13258d16101bd2f3c89622e38ec35928998eb88f936b2dc9522d"} Jul 05 13:18:31.427771 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.427745 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6hlfp" event={"ID":"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a","Type":"ContainerStarted","Data":"d6a7b94b2205cf12c9b860b78cde94798be46843b00b1807cdf7da3a7d01d9b6"} Jul 05 13:18:31.430176 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.430149 2569 generic.go:356] "Generic (PLEG): container finished" podID="11bce2051af4a6b9f223b5c48fe134dc" containerID="f3b6359e4f6774886a7e0aa7871ffba8a436d2cdf46f83fec348f5fad8a3c168" exitCode=0 Jul 05 13:18:31.430254 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.430225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerDied","Data":"f3b6359e4f6774886a7e0aa7871ffba8a436d2cdf46f83fec348f5fad8a3c168"} Jul 05 13:18:31.432728 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.432704 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f8hhr" event={"ID":"86065ff3-869e-4ac7-be22-99c66b70f51a","Type":"ContainerStarted","Data":"2de9b75957b7d01daa8df7688ac2190fddbc72617d20a731c0930c3bc4d14a23"} Jul 05 13:18:31.435646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.435593 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" podStartSLOduration=2.435576772 podStartE2EDuration="2.435576772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:31.435185496 +0000 UTC m=+3.516100882" watchObservedRunningTime="2026-07-05 13:18:31.435576772 +0000 UTC m=+3.516492158" Jul 05 13:18:31.902212 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:31.901643 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:31.902212 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.901781 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:31.902212 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:31.901842 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:33.901824372 +0000 UTC m=+5.982739740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:32.002464 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.002419 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:32.002645 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.002590 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:32.002703 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.002669 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:34.00264981 +0000 UTC m=+6.083565179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:32.103961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.103348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:32.103961 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.103538 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:32.103961 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.103557 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:32.103961 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.103570 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:32.103961 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.103631 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:34.103611914 +0000 UTC m=+6.184527280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:32.322220 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.322104 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:30 +0000 UTC" deadline="2028-02-09 22:38:19.419034354 +0000 UTC" Jul 05 13:18:32.322220 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.322164 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14025h19m47.096873575s" Jul 05 13:18:32.410021 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.409488 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:32.410021 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.409614 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:32.410575 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.410371 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:32.410575 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:32.410532 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:32.452539 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:32.452468 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerStarted","Data":"2568e1088bd9e222183dd178663d4974a94f5033b084ed3cd880572eeb1caf00"} Jul 05 13:18:33.409111 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:33.408623 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:33.409111 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:33.408768 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:33.920781 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:33.920155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:33.920781 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:33.920347 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:33.920781 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:33.920453 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:37.920432664 +0000 UTC m=+10.001348032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:34.020810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:34.020725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:34.020984 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.020881 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:34.020984 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.020948 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:38.020930208 +0000 UTC m=+10.101845573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:34.121594 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:34.121559 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:34.121777 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.121743 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:34.121777 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.121762 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:34.121777 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.121774 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:34.121925 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.121832 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:38.121812543 +0000 UTC m=+10.202727909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:34.409199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:34.408617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:34.409199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:34.408655 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:34.409199 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.408761 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:34.409199 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:34.409156 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:35.409446 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:35.408967 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:35.409446 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:35.409113 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:36.409570 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:36.409477 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:36.409927 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:36.409636 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:36.409927 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:36.409864 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:36.410041 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:36.409969 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:37.408885 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:37.408836 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:37.409065 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:37.408963 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:37.952964 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:37.952923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:37.953468 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:37.953058 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:37.953468 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:37.953121 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:45.953102346 +0000 UTC m=+18.034017714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:38.054291 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:38.054253 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:38.054475 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.054405 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:38.054475 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.054470 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:46.054450259 +0000 UTC m=+18.135365637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:38.155208 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:38.155147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:38.155366 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.155305 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:38.155366 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.155323 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:38.155366 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.155335 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:38.155558 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.155412 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:46.155391558 +0000 UTC m=+18.236306933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:38.409903 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:38.409871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:38.410071 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.409985 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:38.410486 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:38.410449 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:38.410602 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:38.410564 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:39.408819 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:39.408786 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:39.409935 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:39.409901 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:40.409174 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:40.409130 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:40.409730 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:40.409128 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:40.409730 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:40.409260 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:40.409730 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:40.409322 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:41.409115 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:41.409090 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:41.409268 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:41.409186 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:42.409005 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:42.408973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:42.409184 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:42.409090 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:42.409184 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:42.409171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:42.409297 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:42.409270 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:43.408855 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:43.408824 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:43.409019 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:43.408945 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:44.409310 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:44.409279 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:44.409740 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:44.409423 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:44.409740 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:44.409467 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:44.409740 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:44.409582 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:45.408675 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:45.408648 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:45.408859 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:45.408763 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:46.012079 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:46.012046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:46.012565 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.012207 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:46.012565 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.012287 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:19:02.012267192 +0000 UTC m=+34.093182557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:46.112500 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:46.112461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:46.112671 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.112614 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:46.112720 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.112675 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:02.112657937 +0000 UTC m=+34.193573305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:46.213006 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:46.212974 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:46.213172 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.213115 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:46.213172 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.213133 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:46.213172 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.213144 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:46.213300 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.213192 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:02.213179924 +0000 UTC m=+34.294095287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:46.408642 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:46.408608 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:46.408805 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.408753 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:46.408880 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:46.408804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:46.408931 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:46.408907 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:47.408774 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:47.408735 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:47.409199 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:47.408876 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:48.409857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:48.409820 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:48.410329 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:48.409935 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:48.410329 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:48.409973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:48.410329 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:48.410045 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:49.409390 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:49.409352 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:49.409567 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:49.409468 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:50.408962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.408631 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:50.409701 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.408643 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:50.409701 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:50.409069 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:50.409701 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:50.409138 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:50.488790 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.488766 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkf7k" event={"ID":"cb639378-efc6-4433-b34e-700b3bf58d6b","Type":"ContainerStarted","Data":"e2b38804fd50b8a967b2bd36b5463f146b0005a9f3cc588d81356b152c85ab0e"} Jul 05 13:18:50.490087 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.490061 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" event={"ID":"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be","Type":"ContainerStarted","Data":"f877e03f68843c99ee7f77dead0764ff636a4f9ff8adb1043cfc02c278be6702"} Jul 05 13:18:50.491256 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.491233 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zk6j" event={"ID":"6fbfa86c-c677-4091-901f-c936a865545b","Type":"ContainerStarted","Data":"dcce8a61d931cdc850347bf4e1019dcc4ed45be0e2a5cc5335da20debde5aa02"} Jul 05 13:18:50.492604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.492579 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" event={"ID":"70910fbb-7807-4042-afbb-9b6fb9bce39e","Type":"ContainerStarted","Data":"b1e8c2a0c6e7b3ff52437f7c348331b04d70dd9548318b7bd4daa73ff148767f"} Jul 05 13:18:50.494605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.494588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"75a2c8c64560bfd81df817d39d59d3c4e438fb38ee7db4070bfff007ddbc64ca"} Jul 05 13:18:50.494698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.494646 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"37e289fb929f5fad9530ca386f2ec2dd6c367d7fa9cd94a20fe59d9e745c95a7"} Jul 05 13:18:50.494698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.494686 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"ba0533cc840f444fa13282ec41513fd812e661c9107ecad73dcd88b4ebac79de"} Jul 05 13:18:50.494788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.494723 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"5611768efcba610dcb35e37f925f7f5e29d50b6cf7242155157882adb0501a10"} Jul 05 13:18:50.495834 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.495815 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6hlfp" event={"ID":"6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a","Type":"ContainerStarted","Data":"bef1e8a3312be44038eb1a1afac3cfd9b62340d870119ac353da3c62c26ac740"} Jul 05 13:18:50.496970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.496953 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f8hhr" event={"ID":"86065ff3-869e-4ac7-be22-99c66b70f51a","Type":"ContainerStarted","Data":"ef458e7c57f362aaf12e6dc0498486a74f6abc38b1a9642a3ed80bb14ab2cd3d"} Jul 05 13:18:50.498265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.498248 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="bf7a63ee4624cabd6d17b309951875cf394eb9105005f36e894eaceafddbf1d1" exitCode=0 Jul 05 13:18:50.498341 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.498272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"bf7a63ee4624cabd6d17b309951875cf394eb9105005f36e894eaceafddbf1d1"} Jul 05 13:18:50.503905 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.503871 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xkf7k" podStartSLOduration=3.623072116 podStartE2EDuration="22.503860972s" totalImagesPullingTime="18.880788856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.503719061 +0000 UTC m=+22.584634458" watchObservedRunningTime="2026-07-05 13:18:50.503860972 +0000 UTC m=+22.584776357" Jul 05 13:18:50.504173 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.504145 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" podStartSLOduration=21.504135749 podStartE2EDuration="21.504135749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:32.468169795 +0000 UTC m=+4.549085179" watchObservedRunningTime="2026-07-05 13:18:50.504135749 +0000 UTC m=+22.585051136" Jul 05 13:18:50.544944 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.544907 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8zk6j" podStartSLOduration=3.470659915 podStartE2EDuration="22.544894946s" totalImagesPullingTime="19.074235031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.544374533 +0000 UTC m=+22.625289922" watchObservedRunningTime="2026-07-05 13:18:50.544894946 +0000 UTC m=+22.625810332" Jul 05 13:18:50.560200 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.560161 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f8hhr" podStartSLOduration=3.704639489 podStartE2EDuration="22.560148417s" totalImagesPullingTime="18.855508928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.559988079 +0000 UTC m=+22.640903464" watchObservedRunningTime="2026-07-05 13:18:50.560148417 +0000 UTC m=+22.641063800" Jul 05 13:18:50.581625 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:50.581590 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7m8cw" podStartSLOduration=3.718350987 podStartE2EDuration="22.581580199s" totalImagesPullingTime="18.863229212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.580827577 +0000 UTC m=+22.661742962" watchObservedRunningTime="2026-07-05 13:18:50.581580199 +0000 UTC m=+22.662495581" Jul 05 13:18:51.071198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.071162 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:51.071881 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.071858 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:51.098125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.098070 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6hlfp" podStartSLOduration=4.275821556 podStartE2EDuration="23.098055974s" totalImagesPullingTime="18.822234418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.604135519 +0000 UTC m=+22.685050902" watchObservedRunningTime="2026-07-05 13:18:51.098055974 +0000 UTC m=+23.178971360" Jul 05 13:18:51.409088 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.409055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:51.409539 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:51.409206 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:51.503831 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.503793 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"35eb8b9f5733c85a4aae120c9d2ac65912a449b35314675108d5101eb65e4934"} Jul 05 13:18:51.503983 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.503883 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"6e095810fbf1d65fe3b35f3896fdf3e1fcf5ee01fbb12f3780fecb6c753edfd7"} Jul 05 13:18:51.505303 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.505255 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6xbw" event={"ID":"0b70827d-c69f-4d5d-b7ac-57d9b81f498f","Type":"ContainerStarted","Data":"40c166df0da4c962f49334446104453ec698ec40c1ce6fd4d5cd2f32ae7da3fd"} Jul 05 13:18:51.506127 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.506103 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:51.506246 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.506160 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6hlfp" Jul 05 13:18:51.521349 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.521309 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l6xbw" podStartSLOduration=4.705611946 podStartE2EDuration="23.521295701s" totalImagesPullingTime="18.815683755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:51.520993741 +0000 UTC m=+23.601909127" watchObservedRunningTime="2026-07-05 13:18:51.521295701 +0000 UTC m=+23.602211085" Jul 05 13:18:51.881258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:51.881231 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 13:18:52.346473 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.346335 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:18:51.881252689Z","UUID":"78e58cd3-06ad-4c3a-aa36-ab787d999d2c","Handler":null,"Name":"","Endpoint":""} Jul 05 13:18:52.348315 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.348291 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 13:18:52.348452 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.348324 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 13:18:52.408899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.408844 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:52.409061 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:52.408961 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:52.409061 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.408844 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:52.409061 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:52.409053 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:52.509856 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:52.509813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" event={"ID":"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be","Type":"ContainerStarted","Data":"3df5430047c7bf1faefc1e0fffd6e0f9ecd989b894b40df7187f5b0ce5d3a0b1"} Jul 05 13:18:53.408505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:53.408474 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:53.408749 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:53.408602 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:53.515703 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:53.515661 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"c4e8637fb4e453d30c02bb84a9ea6cd8104cb61f0536897e20cb4f5e6e83d486"} Jul 05 13:18:54.408798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:54.408766 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:54.409063 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:54.408891 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:54.409063 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:54.408957 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:54.409180 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:54.409111 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:55.366157 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.365952 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:55.408640 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.408617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:55.408754 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:55.408742 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:55.464974 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.464942 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:55.520755 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.520729 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="013b21f9203219c5a847b46cf4965457d2ba943658ba78181174960b72148715" exitCode=0 Jul 05 13:18:55.520870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.520799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"013b21f9203219c5a847b46cf4965457d2ba943658ba78181174960b72148715"} Jul 05 13:18:55.523061 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.522891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" event={"ID":"4658f72c-7537-4a8e-9f17-9f6c6c2bd3be","Type":"ContainerStarted","Data":"14f7efe4355685f3924dd409ea7b96cfd5d5dddbcd4dd32646628899804c604a"} Jul 05 13:18:55.526526 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.526502 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" event={"ID":"dd9dcf19-3522-4ad0-88bf-3cf51f4c3f18","Type":"ContainerStarted","Data":"7a23aa7f5ba374175491651620ed036a3165cac22f62e63d48698cc51ddad5da"} Jul 05 13:18:55.526776 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.526756 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:55.526853 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.526844 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:55.542085 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.542065 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:55.603007 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.602966 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" podStartSLOduration=8.671549562 podStartE2EDuration="27.602951586s" totalImagesPullingTime="18.931402024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:55.57965924 +0000 UTC m=+27.660574622" watchObservedRunningTime="2026-07-05 13:18:55.602951586 +0000 UTC m=+27.683866971" Jul 05 13:18:55.603172 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:55.603153 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lb9dx" podStartSLOduration=4.544231119 podStartE2EDuration="27.60314631s" totalImagesPullingTime="23.058915191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:55.602743699 +0000 UTC m=+27.683659086" watchObservedRunningTime="2026-07-05 13:18:55.60314631 +0000 UTC m=+27.684061695" Jul 05 13:18:56.409291 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.409262 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:56.409647 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:56.409348 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:56.409647 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.409451 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:56.409647 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:56.409558 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:56.528631 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.528600 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:56.542771 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.542748 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:18:56.755142 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.755113 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:56.855704 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.855675 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:56.957206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:56.957134 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:57.029836 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.029809 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:57.253888 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.253866 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:57.360430 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.360377 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:18:57.393978 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.393950 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xpht5"] Jul 05 13:18:57.394105 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.394053 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:57.394166 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:57.394134 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:57.399494 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.399472 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhr8d"] Jul 05 13:18:57.399599 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.399556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:57.399669 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:57.399650 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:57.400058 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.400042 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgr2m"] Jul 05 13:18:57.400143 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.400133 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:57.400213 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:57.400198 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:57.532680 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.532618 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="416e5e4a0ab11242d891705a35131cc60310496529814dbf72847c2833ab33eb" exitCode=0 Jul 05 13:18:57.533021 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:57.532700 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"416e5e4a0ab11242d891705a35131cc60310496529814dbf72847c2833ab33eb"} Jul 05 13:18:59.408858 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:59.408708 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:18:59.409267 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:59.408759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:18:59.409267 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:59.408939 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:18:59.409267 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:59.409029 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:18:59.409267 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:59.408759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:18:59.409267 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:18:59.409180 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:18:59.538285 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:59.538259 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="2c60340f114c6306abc3c5e2fcba81881da16794adcecabc1897aa8e7e4f9df3" exitCode=0 Jul 05 13:18:59.538436 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:18:59.538310 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"2c60340f114c6306abc3c5e2fcba81881da16794adcecabc1897aa8e7e4f9df3"} Jul 05 13:19:01.409414 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:01.409316 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:01.409414 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:01.409368 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:19:01.409963 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:01.409446 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:01.409963 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:01.409465 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xpht5" podUID="b0ef5b25-e287-46ac-a7f3-114970c43581" Jul 05 13:19:01.409963 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:01.409515 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhr8d" podUID="7b657fe4-b60c-4298-b201-3a6d10bb345b" Jul 05 13:19:01.409963 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:01.409608 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgr2m" podUID="9ff50a7e-13d6-4fc4-954d-0a7051d32608" Jul 05 13:19:02.038156 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.038113 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:02.038333 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.038261 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:02.038407 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.038331 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret podName:7b657fe4-b60c-4298-b201-3a6d10bb345b nodeName:}" failed. No retries permitted until 2026-07-05 13:19:34.038311172 +0000 UTC m=+66.119226536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret") pod "global-pull-secret-syncer-bhr8d" (UID: "7b657fe4-b60c-4298-b201-3a6d10bb345b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:02.139242 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.139209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:19:02.139432 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.139341 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:02.139432 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.139427 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:34.139407978 +0000 UTC m=+66.220323356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:02.240552 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.240515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:02.240708 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.240661 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:19:02.240708 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.240686 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:19:02.240708 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.240695 2569 projected.go:196] Error preparing data for projected volume kube-api-access-wp26m for pod openshift-network-diagnostics/network-check-target-xpht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:02.240873 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.240754 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m podName:b0ef5b25-e287-46ac-a7f3-114970c43581 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:34.240739947 +0000 UTC m=+66.321655311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp26m" (UniqueName: "kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m") pod "network-check-target-xpht5" (UID: "b0ef5b25-e287-46ac-a7f3-114970c43581") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:02.688962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.688928 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeReady" Jul 05 13:19:02.689970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.689090 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 13:19:02.732624 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.732589 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8b584"] Jul 05 13:19:02.735360 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.735333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.737935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.737914 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xsn9p"] Jul 05 13:19:02.738753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.738560 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7gnk\"" Jul 05 13:19:02.738753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.738652 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 13:19:02.738753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.738714 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 13:19:02.739700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.739679 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.741934 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.741912 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq4hl\"" Jul 05 13:19:02.742442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.742336 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 13:19:02.742442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.742401 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 13:19:02.742663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.742645 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 13:19:02.748763 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.748745 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8b584"] Jul 05 13:19:02.751860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.751461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsn9p"] Jul 05 13:19:02.845022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.844924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a78522ad-9741-4a1e-9490-6722105f8d70-config-volume\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.845022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.844973 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cm4t\" (UniqueName: \"kubernetes.io/projected/a78522ad-9741-4a1e-9490-6722105f8d70-kube-api-access-2cm4t\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.845258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.845081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9tb\" (UniqueName: \"kubernetes.io/projected/09ccf996-d4b7-4492-9c19-2e368be34501-kube-api-access-7q9tb\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.845258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.845124 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09ccf996-d4b7-4492-9c19-2e368be34501-cert\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.845258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.845153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.845258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.845188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78522ad-9741-4a1e-9490-6722105f8d70-tmp-dir\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.945833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.945796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cm4t\" (UniqueName: \"kubernetes.io/projected/a78522ad-9741-4a1e-9490-6722105f8d70-kube-api-access-2cm4t\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.946008 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.945866 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9tb\" (UniqueName: \"kubernetes.io/projected/09ccf996-d4b7-4492-9c19-2e368be34501-kube-api-access-7q9tb\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.946008 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.945897 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09ccf996-d4b7-4492-9c19-2e368be34501-cert\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.946008 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.945988 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:02.946185 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:02.946050 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:03.446032187 +0000 UTC m=+35.526947551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:02.946185 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.945984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.946185 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.946138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78522ad-9741-4a1e-9490-6722105f8d70-tmp-dir\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.946338 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.946200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a78522ad-9741-4a1e-9490-6722105f8d70-config-volume\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.946545 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.946522 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78522ad-9741-4a1e-9490-6722105f8d70-tmp-dir\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.946747 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.946729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a78522ad-9741-4a1e-9490-6722105f8d70-config-volume\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.950745 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.950722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09ccf996-d4b7-4492-9c19-2e368be34501-cert\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:02.954793 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.954772 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cm4t\" (UniqueName: \"kubernetes.io/projected/a78522ad-9741-4a1e-9490-6722105f8d70-kube-api-access-2cm4t\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:02.954961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:02.954938 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9tb\" (UniqueName: \"kubernetes.io/projected/09ccf996-d4b7-4492-9c19-2e368be34501-kube-api-access-7q9tb\") pod \"ingress-canary-xsn9p\" (UID: \"09ccf996-d4b7-4492-9c19-2e368be34501\") " pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:03.054201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.054171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsn9p" Jul 05 13:19:03.409035 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.408996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:03.409035 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.409019 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:03.409272 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.408997 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:19:03.413374 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413354 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:03.413534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413354 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7qg\"" Jul 05 13:19:03.413534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413358 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2lc5\"" Jul 05 13:19:03.413534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413356 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:03.413534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413465 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 13:19:03.413534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.413512 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 13:19:03.450743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.450720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:03.450893 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:03.450829 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:03.450893 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:03.450880 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:04.450865644 +0000 UTC m=+36.531781007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:03.557102 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:03.557079 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsn9p"] Jul 05 13:19:03.560920 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:03.560897 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ccf996_d4b7_4492_9c19_2e368be34501.slice/crio-6244f33b4ea9a149614d5e1c442fcc6df5c72b2ae371c5322a69ff85b0c999b3 WatchSource:0}: Error finding container 6244f33b4ea9a149614d5e1c442fcc6df5c72b2ae371c5322a69ff85b0c999b3: Status 404 returned error can't find the container with id 6244f33b4ea9a149614d5e1c442fcc6df5c72b2ae371c5322a69ff85b0c999b3 Jul 05 13:19:04.459157 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:04.459097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:04.459673 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:04.459249 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:04.459673 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:04.459315 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:06.459294805 +0000 UTC m=+38.540210182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:04.555227 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:04.554819 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsn9p" event={"ID":"09ccf996-d4b7-4492-9c19-2e368be34501","Type":"ContainerStarted","Data":"6244f33b4ea9a149614d5e1c442fcc6df5c72b2ae371c5322a69ff85b0c999b3"} Jul 05 13:19:04.559703 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:04.559673 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="d74c939e5c8c2d69ff5ec1db2c8f67c1363f69af83a5ca24efa36726454d9886" exitCode=0 Jul 05 13:19:04.559836 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:04.559711 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"d74c939e5c8c2d69ff5ec1db2c8f67c1363f69af83a5ca24efa36726454d9886"} Jul 05 13:19:05.564601 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:05.564573 2569 generic.go:356] "Generic (PLEG): container finished" podID="de730594-936e-4685-80bb-c2982023ac1c" containerID="e8381546f4249778dcd1aab3c9d7a435c78c7f1f06d38e4aeaf5e350de5d6eb1" exitCode=0 Jul 05 13:19:05.564890 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:05.564614 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerDied","Data":"e8381546f4249778dcd1aab3c9d7a435c78c7f1f06d38e4aeaf5e350de5d6eb1"} Jul 05 13:19:06.026542 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.026372 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:06.093556 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.093521 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:06.472967 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.472942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:06.473113 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:06.473048 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:06.473113 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:06.473098 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:10.473084341 +0000 UTC m=+42.553999704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:06.569700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.569669 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" event={"ID":"de730594-936e-4685-80bb-c2982023ac1c","Type":"ContainerStarted","Data":"3bbd4ce0f0cbbd01f781c4fa0d386a0e26830c61c18021afb87e1466252c368e"} Jul 05 13:19:06.571024 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.570999 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsn9p" event={"ID":"09ccf996-d4b7-4492-9c19-2e368be34501","Type":"ContainerStarted","Data":"5e4621333f8ea42717e1681492b7be4e4eefcccf70199671edc079769f06a2f9"} Jul 05 13:19:06.594905 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.594861 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z2tqc" podStartSLOduration=9.439929534000001 podStartE2EDuration="38.59484273s" totalImagesPullingTime="29.154913196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:06.593061775 +0000 UTC m=+38.673977161" watchObservedRunningTime="2026-07-05 13:19:06.59484273 +0000 UTC m=+38.675758116" Jul 05 13:19:06.609716 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.609681 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xsn9p" podStartSLOduration=2.639004622 podStartE2EDuration="4.609672207s" totalImagesPullingTime="1.970667585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:06.609439059 +0000 UTC m=+38.690354444" watchObservedRunningTime="2026-07-05 13:19:06.609672207 +0000 UTC m=+38.690587592" Jul 05 13:19:06.686332 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.686300 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:06.745755 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.745670 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:06.805002 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:06.804971 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:08.380049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:08.380010 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:10.499085 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:10.499054 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:10.499456 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:10.499174 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:10.499456 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:10.499222 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:18.499209341 +0000 UTC m=+50.580124704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:16.714169 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.714137 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj"] Jul 05 13:19:16.758191 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.758163 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj"] Jul 05 13:19:16.758340 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.758251 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" Jul 05 13:19:16.761542 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.761519 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hd8ls\"" Jul 05 13:19:16.761654 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.761581 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:19:16.762674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.762659 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 05 13:19:16.833692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.833666 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c6675b69f-2vscq"] Jul 05 13:19:16.850017 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.849998 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:16.859481 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.859461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6675b69f-2vscq"] Jul 05 13:19:16.861869 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.861852 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 13:19:16.862697 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.862684 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 05 13:19:16.862753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.862737 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 13:19:16.862787 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.862758 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 05 13:19:16.862959 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.862946 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vpshd\"" Jul 05 13:19:16.863135 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.863123 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 05 13:19:16.869810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.869794 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 05 13:19:16.944555 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944533 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:16.944668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944562 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9g7j\" (UniqueName: \"kubernetes.io/projected/3c18daa4-755b-4939-891a-192f08c6a624-kube-api-access-c9g7j\") pod \"volume-data-source-validator-5d456fdbcd-62slj\" (UID: \"3c18daa4-755b-4939-891a-192f08c6a624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" Jul 05 13:19:16.944668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-stats-auth\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:16.944668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944623 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:16.944813 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-default-certificate\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:16.944813 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:16.944710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4q42\" (UniqueName: \"kubernetes.io/projected/669c8f24-bdb5-4579-8b26-c0c071070684-kube-api-access-t4q42\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.045915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.045841 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-stats-auth\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.045915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.045876 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.045915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.045900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-default-certificate\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.046141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.045923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4q42\" (UniqueName: \"kubernetes.io/projected/669c8f24-bdb5-4579-8b26-c0c071070684-kube-api-access-t4q42\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.046141 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.046000 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:17.046141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.046020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.046141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.046047 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9g7j\" (UniqueName: \"kubernetes.io/projected/3c18daa4-755b-4939-891a-192f08c6a624-kube-api-access-c9g7j\") pod \"volume-data-source-validator-5d456fdbcd-62slj\" (UID: \"3c18daa4-755b-4939-891a-192f08c6a624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" Jul 05 13:19:17.046141 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.046072 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:17.546054381 +0000 UTC m=+49.626969744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:17.046346 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.046299 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:17.54626642 +0000 UTC m=+49.627181798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:17.049907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.049890 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-default-certificate\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.049972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.049889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-stats-auth\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.064095 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.064070 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4q42\" (UniqueName: \"kubernetes.io/projected/669c8f24-bdb5-4579-8b26-c0c071070684-kube-api-access-t4q42\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.070415 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.070397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9g7j\" (UniqueName: \"kubernetes.io/projected/3c18daa4-755b-4939-891a-192f08c6a624-kube-api-access-c9g7j\") pod \"volume-data-source-validator-5d456fdbcd-62slj\" (UID: \"3c18daa4-755b-4939-891a-192f08c6a624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" Jul 05 13:19:17.093144 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.093121 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:17.191273 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.191243 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:17.367333 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.367262 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" Jul 05 13:19:17.509165 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.509124 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj"] Jul 05 13:19:17.513297 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:17.513264 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c18daa4_755b_4939_891a_192f08c6a624.slice/crio-2e35780b9128bcfdfef2081d06acddbebc774da93957e850702f4959c15fab4a WatchSource:0}: Error finding container 2e35780b9128bcfdfef2081d06acddbebc774da93957e850702f4959c15fab4a: Status 404 returned error can't find the container with id 2e35780b9128bcfdfef2081d06acddbebc774da93957e850702f4959c15fab4a Jul 05 13:19:17.551372 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.551346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.551484 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.551410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:17.551548 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.551534 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:17.551588 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.551543 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:18.55152443 +0000 UTC m=+50.632439804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:17.551588 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:17.551576 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:18.551566009 +0000 UTC m=+50.632481374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:17.597460 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:17.597433 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" event={"ID":"3c18daa4-755b-4939-891a-192f08c6a624","Type":"ContainerStarted","Data":"2e35780b9128bcfdfef2081d06acddbebc774da93957e850702f4959c15fab4a"} Jul 05 13:19:18.307622 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:18.307586 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:18.370811 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:18.370777 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:18.558676 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:18.558596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:18.558676 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:18.558660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:18.558837 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:18.558742 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:18.558837 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:18.558772 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:18.558837 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:18.558820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:18.558944 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:18.558837 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.558816532 +0000 UTC m=+52.639731895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:18.558944 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:18.558871 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls podName:a78522ad-9741-4a1e-9490-6722105f8d70 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:34.558860622 +0000 UTC m=+66.639775991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls") pod "dns-default-8b584" (UID: "a78522ad-9741-4a1e-9490-6722105f8d70") : secret "dns-default-metrics-tls" not found Jul 05 13:19:18.558944 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:18.558940 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.558927559 +0000 UTC m=+52.639842940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:19.195690 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.195655 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:19.248763 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.248736 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:19.603423 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.603329 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" event={"ID":"3c18daa4-755b-4939-891a-192f08c6a624","Type":"ContainerStarted","Data":"eea081f264ccda86c6bc82065fa713b4c4307924057b94363c1c37ab03290fe5"} Jul 05 13:19:19.628857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.628817 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-62slj" podStartSLOduration=2.382660424 podStartE2EDuration="3.628805105s" totalImagesPullingTime="1.246144681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:19.627821535 +0000 UTC m=+51.708736916" watchObservedRunningTime="2026-07-05 13:19:19.628805105 +0000 UTC m=+51.709720489" Jul 05 13:19:19.773433 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.773371 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:19.889903 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:19.889823 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:20.572728 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:20.572694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:20.572911 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:20.572775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:20.572911 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:20.572865 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:20.572911 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:20.572882 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.572868903 +0000 UTC m=+56.653784266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:20.573037 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:20.572925 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.572907812 +0000 UTC m=+56.653823175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:20.774084 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:20.774046 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:20.869086 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:20.869013 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:20.957676 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:20.957639 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.343505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.343475 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6rd"] Jul 05 13:19:21.345245 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.345229 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.348066 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.348042 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 13:19:21.348328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.348301 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 13:19:21.348453 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.348328 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n6z8z\"" Jul 05 13:19:21.349404 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.349374 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 13:19:21.349452 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.349374 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 13:19:21.374645 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.374621 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6rd"] Jul 05 13:19:21.397049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.397011 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.478583 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.478558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87w5\" (UniqueName: \"kubernetes.io/projected/b17aedc2-4300-4910-8848-fb44c750e94f-kube-api-access-p87w5\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.478719 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.478602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.478719 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.478708 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b17aedc2-4300-4910-8848-fb44c750e94f-crio-socket\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.478811 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.478740 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.478811 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.478786 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b17aedc2-4300-4910-8848-fb44c750e94f-data-volume\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.479483 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.479455 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.579205 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579337 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579240 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b17aedc2-4300-4910-8848-fb44c750e94f-crio-socket\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579337 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579302 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b17aedc2-4300-4910-8848-fb44c750e94f-crio-socket\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579337 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:21.579305 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:21.579478 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579345 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579478 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:21.579357 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.079344105 +0000 UTC m=+54.160259468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : configmap "kube-rbac-proxy" not found Jul 05 13:19:21.579478 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b17aedc2-4300-4910-8848-fb44c750e94f-data-volume\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579478 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:21.579438 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:21.579478 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579469 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87w5\" (UniqueName: \"kubernetes.io/projected/b17aedc2-4300-4910-8848-fb44c750e94f-kube-api-access-p87w5\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.579772 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:21.579486 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.079473141 +0000 UTC m=+54.160388505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:21.579832 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.579784 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b17aedc2-4300-4910-8848-fb44c750e94f-data-volume\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.629988 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.629932 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87w5\" (UniqueName: \"kubernetes.io/projected/b17aedc2-4300-4910-8848-fb44c750e94f-kube-api-access-p87w5\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:21.696070 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.696036 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.726489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.726461 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct"] Jul 05 13:19:21.728153 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.728138 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" Jul 05 13:19:21.731185 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.731165 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 05 13:19:21.731265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.731237 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t6ltc\"" Jul 05 13:19:21.731505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.731490 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 05 13:19:21.742661 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.742643 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct"] Jul 05 13:19:21.814430 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.814407 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.882328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.882260 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb7wp\" (UniqueName: \"kubernetes.io/projected/cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad-kube-api-access-jb7wp\") pod \"migrator-d57d58cc9-cwrct\" (UID: \"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" Jul 05 13:19:21.915465 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.915438 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:21.982885 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.982863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb7wp\" (UniqueName: \"kubernetes.io/projected/cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad-kube-api-access-jb7wp\") pod \"migrator-d57d58cc9-cwrct\" (UID: \"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" Jul 05 13:19:21.993794 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:21.993777 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb7wp\" (UniqueName: \"kubernetes.io/projected/cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad-kube-api-access-jb7wp\") pod \"migrator-d57d58cc9-cwrct\" (UID: \"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" Jul 05 13:19:22.036838 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:22.036815 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" Jul 05 13:19:22.084097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:22.084065 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:22.084198 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:22.084156 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:22.084198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:22.084169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:22.084306 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:22.084229 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.08420861 +0000 UTC m=+55.165123979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : configmap "kube-rbac-proxy" not found Jul 05 13:19:22.084755 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:22.084734 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:22.084842 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:22.084822 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.084806378 +0000 UTC m=+55.165721760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:22.182814 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:22.182783 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct"] Jul 05 13:19:22.185961 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:22.185931 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb32c60d_0ff5_4ed4_a331_77ac3be0a1ad.slice/crio-32fea9bfc2627634b60f6801848285dec3b4b2b6cbde26a72b41d97e88288fd9 WatchSource:0}: Error finding container 32fea9bfc2627634b60f6801848285dec3b4b2b6cbde26a72b41d97e88288fd9: Status 404 returned error can't find the container with id 32fea9bfc2627634b60f6801848285dec3b4b2b6cbde26a72b41d97e88288fd9 Jul 05 13:19:22.611350 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:22.611261 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" event={"ID":"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad","Type":"ContainerStarted","Data":"32fea9bfc2627634b60f6801848285dec3b4b2b6cbde26a72b41d97e88288fd9"} Jul 05 13:19:23.092958 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.092926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:23.093331 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.093003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:23.093331 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:23.093067 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:23.093331 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:23.093077 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:23.093331 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:23.093120 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.093105925 +0000 UTC m=+57.174021287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : configmap "kube-rbac-proxy" not found Jul 05 13:19:23.093331 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:23.093133 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.093127141 +0000 UTC m=+57.174042504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:23.250528 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.250495 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:23.274352 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.274322 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkf7k_cb639378-efc6-4433-b34e-700b3bf58d6b/dns-node-resolver/0.log" Jul 05 13:19:23.312604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.312573 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t"] Jul 05 13:19:23.314624 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.314590 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" Jul 05 13:19:23.317668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.317645 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hcjmf\"" Jul 05 13:19:23.324779 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.324749 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t"] Jul 05 13:19:23.366802 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.366736 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:23.395968 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.395943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4kcr\" (UniqueName: \"kubernetes.io/projected/f99ed55e-e405-4753-b4a1-4b03c1cd54a5-kube-api-access-v4kcr\") pod \"network-check-source-989f8b8dc-cld7t\" (UID: \"f99ed55e-e405-4753-b4a1-4b03c1cd54a5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" Jul 05 13:19:23.496437 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.496411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4kcr\" (UniqueName: \"kubernetes.io/projected/f99ed55e-e405-4753-b4a1-4b03c1cd54a5-kube-api-access-v4kcr\") pod \"network-check-source-989f8b8dc-cld7t\" (UID: \"f99ed55e-e405-4753-b4a1-4b03c1cd54a5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" Jul 05 13:19:23.521151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.521109 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4kcr\" (UniqueName: \"kubernetes.io/projected/f99ed55e-e405-4753-b4a1-4b03c1cd54a5-kube-api-access-v4kcr\") pod \"network-check-source-989f8b8dc-cld7t\" (UID: \"f99ed55e-e405-4753-b4a1-4b03c1cd54a5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" Jul 05 13:19:23.615905 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.615872 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" event={"ID":"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad","Type":"ContainerStarted","Data":"4e901e392ac2a3346945c04754c03662efa7e191c4c52a2df1c7a7253ce04f27"} Jul 05 13:19:23.616033 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.615963 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" event={"ID":"cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad","Type":"ContainerStarted","Data":"b708a9acdce1f35182b842afc29275aeaf5fbc41d212ea4e17884c0e67701afb"} Jul 05 13:19:23.625289 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.625234 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" Jul 05 13:19:23.644367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.644323 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-cwrct" podStartSLOduration=1.407655424 podStartE2EDuration="2.644308579s" totalImagesPullingTime="1.236653155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:23.640224703 +0000 UTC m=+55.721140130" watchObservedRunningTime="2026-07-05 13:19:23.644308579 +0000 UTC m=+55.725223963" Jul 05 13:19:23.774193 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.774158 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t"] Jul 05 13:19:23.777331 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:23.777306 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99ed55e_e405_4753_b4a1_4b03c1cd54a5.slice/crio-c9dee5ebf1876d24802184a54292773054598fbe5ee5448d160f98129bc12e80 WatchSource:0}: Error finding container c9dee5ebf1876d24802184a54292773054598fbe5ee5448d160f98129bc12e80: Status 404 returned error can't find the container with id c9dee5ebf1876d24802184a54292773054598fbe5ee5448d160f98129bc12e80 Jul 05 13:19:23.820482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.820425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:23.930494 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:23.930455 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:24.072756 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:24.072732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f8hhr_86065ff3-869e-4ac7-be22-99c66b70f51a/node-ca/0.log" Jul 05 13:19:24.603937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:24.603902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:24.604360 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:24.604042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:24.604360 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:24.604086 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:24.604360 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:24.604170 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.604156291 +0000 UTC m=+64.685071653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:24.604360 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:24.604196 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.604186519 +0000 UTC m=+64.685101883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:24.620300 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:24.620266 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" event={"ID":"f99ed55e-e405-4753-b4a1-4b03c1cd54a5","Type":"ContainerStarted","Data":"c9dee5ebf1876d24802184a54292773054598fbe5ee5448d160f98129bc12e80"} Jul 05 13:19:24.993151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:24.993106 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:25.109726 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:25.109692 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:25.109883 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:25.109763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:25.109883 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:25.109845 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:25.109883 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:25.109877 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.110053 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:25.109913 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.109894655 +0000 UTC m=+61.190810026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : configmap "kube-rbac-proxy" not found Jul 05 13:19:25.110053 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:25.109930 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.109923431 +0000 UTC m=+61.190838793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.281310 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:25.281234 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsn9p_09ccf996-d4b7-4492-9c19-2e368be34501/serve-healthcheck-canary/0.log" Jul 05 13:19:26.627157 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:26.627086 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" event={"ID":"f99ed55e-e405-4753-b4a1-4b03c1cd54a5","Type":"ContainerStarted","Data":"e06db4c23ad8c99382d979eccc90d1fed610b0b5a7fcd57cbe66fa73f563a0e5"} Jul 05 13:19:26.668068 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:26.668027 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cld7t" podStartSLOduration=1.069985845 podStartE2EDuration="3.66801334s" totalImagesPullingTime="2.598027495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:26.667791607 +0000 UTC m=+58.748707002" watchObservedRunningTime="2026-07-05 13:19:26.66801334 +0000 UTC m=+58.748928724" Jul 05 13:19:28.544365 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:28.544333 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42l6d" Jul 05 13:19:29.140454 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:29.140419 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:29.140623 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:29.140485 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:29.140623 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:29.140531 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:29.140623 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:29.140571 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:29.140623 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:29.140592 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:37.140577452 +0000 UTC m=+69.221492815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : configmap "kube-rbac-proxy" not found Jul 05 13:19:29.140623 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:29.140610 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:37.140599696 +0000 UTC m=+69.221515059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:30.730556 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:30.730520 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:31.001173 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:31.001078 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:31.415174 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:31.415144 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:31.655636 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:31.655598 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:32.127242 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.127209 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:32.316033 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.315997 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:32.554586 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.554555 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:32.665282 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.665253 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:32.665424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.665296 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:32.665424 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:32.665406 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:32.665503 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:32.665433 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.66541512 +0000 UTC m=+80.746330487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:32.665545 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:32.665507 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs podName:669c8f24-bdb5-4579-8b26-c0c071070684 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.665483043 +0000 UTC m=+80.746398416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs") pod "router-default-7c6675b69f-2vscq" (UID: "669c8f24-bdb5-4579-8b26-c0c071070684") : secret "router-metrics-certs-default" not found Jul 05 13:19:32.830599 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:32.830529 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:33.354360 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:33.354327 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:33.716180 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:33.716140 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:33.948824 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:33.948783 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:34.075663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.075587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:34.079422 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.079404 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:34.088642 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.088612 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b657fe4-b60c-4298-b201-3a6d10bb345b-original-pull-secret\") pod \"global-pull-secret-syncer-bhr8d\" (UID: \"7b657fe4-b60c-4298-b201-3a6d10bb345b\") " pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:34.176447 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.176406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:19:34.179667 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.179651 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:34.186765 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:34.186744 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 13:19:34.186814 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:34.186800 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs podName:9ff50a7e-13d6-4fc4-954d-0a7051d32608 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:38.186784514 +0000 UTC m=+130.267699876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs") pod "network-metrics-daemon-rgr2m" (UID: "9ff50a7e-13d6-4fc4-954d-0a7051d32608") : secret "metrics-daemon-secret" not found Jul 05 13:19:34.276765 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.276734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:34.279173 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.279153 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp26m\" (UniqueName: \"kubernetes.io/projected/b0ef5b25-e287-46ac-a7f3-114970c43581-kube-api-access-wp26m\") pod \"network-check-target-xpht5\" (UID: \"b0ef5b25-e287-46ac-a7f3-114970c43581\") " pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:34.321488 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.321463 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhr8d" Jul 05 13:19:34.346961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.346901 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2lc5\"" Jul 05 13:19:34.350300 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.350278 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:34.479501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.479468 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:34.498898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.498865 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhr8d"] Jul 05 13:19:34.501913 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:34.501890 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b657fe4_b60c_4298_b201_3a6d10bb345b.slice/crio-7364faf73424772f3e48bc85a9c4b300c41ce40878eb57a8ca49a11d7e0d6a91 WatchSource:0}: Error finding container 7364faf73424772f3e48bc85a9c4b300c41ce40878eb57a8ca49a11d7e0d6a91: Status 404 returned error can't find the container with id 7364faf73424772f3e48bc85a9c4b300c41ce40878eb57a8ca49a11d7e0d6a91 Jul 05 13:19:34.511991 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.511968 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xpht5"] Jul 05 13:19:34.515078 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:34.515057 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ef5b25_e287_46ac_a7f3_114970c43581.slice/crio-18bafad6747751a2393db3b3d3393a5113f7be0ac4b8bb36b3601c09d1396126 WatchSource:0}: Error finding container 18bafad6747751a2393db3b3d3393a5113f7be0ac4b8bb36b3601c09d1396126: Status 404 returned error can't find the container with id 18bafad6747751a2393db3b3d3393a5113f7be0ac4b8bb36b3601c09d1396126 Jul 05 13:19:34.579293 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.579271 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:34.581328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.581307 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a78522ad-9741-4a1e-9490-6722105f8d70-metrics-tls\") pod \"dns-default-8b584\" (UID: \"a78522ad-9741-4a1e-9490-6722105f8d70\") " pod="openshift-dns/dns-default-8b584" Jul 05 13:19:34.621506 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.621479 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:34.648491 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.648469 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xpht5" event={"ID":"b0ef5b25-e287-46ac-a7f3-114970c43581","Type":"ContainerStarted","Data":"e6c9e3045ffc4f0fbedd344746fef86e1185bac61a627bb7dc0cc69df9e22c96"} Jul 05 13:19:34.648598 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.648514 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xpht5" event={"ID":"b0ef5b25-e287-46ac-a7f3-114970c43581","Type":"ContainerStarted","Data":"18bafad6747751a2393db3b3d3393a5113f7be0ac4b8bb36b3601c09d1396126"} Jul 05 13:19:34.648598 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.648592 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:19:34.649668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.649648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhr8d" event={"ID":"7b657fe4-b60c-4298-b201-3a6d10bb345b","Type":"ContainerStarted","Data":"7364faf73424772f3e48bc85a9c4b300c41ce40878eb57a8ca49a11d7e0d6a91"} Jul 05 13:19:34.678779 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.678744 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xpht5" podStartSLOduration=66.678730613 podStartE2EDuration="1m6.678730613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:34.678040693 +0000 UTC m=+66.758956078" watchObservedRunningTime="2026-07-05 13:19:34.678730613 +0000 UTC m=+66.759645997" Jul 05 13:19:34.850189 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.850165 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7gnk\"" Jul 05 13:19:34.857209 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.857182 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8b584" Jul 05 13:19:34.858013 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.857987 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:34.995573 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:34.995541 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:35.001755 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:35.001729 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8b584"] Jul 05 13:19:35.006281 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:35.006259 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78522ad_9741_4a1e_9490_6722105f8d70.slice/crio-66cf937099a3e4299afbabc45c66887b09f07d1341670facb080ac5cc3be6ce0 WatchSource:0}: Error finding container 66cf937099a3e4299afbabc45c66887b09f07d1341670facb080ac5cc3be6ce0: Status 404 returned error can't find the container with id 66cf937099a3e4299afbabc45c66887b09f07d1341670facb080ac5cc3be6ce0 Jul 05 13:19:35.157866 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:35.157830 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:35.383549 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:35.383514 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:35.553292 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:35.553137 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:35.654836 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:35.654689 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b584" event={"ID":"a78522ad-9741-4a1e-9490-6722105f8d70","Type":"ContainerStarted","Data":"66cf937099a3e4299afbabc45c66887b09f07d1341670facb080ac5cc3be6ce0"} Jul 05 13:19:36.155051 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:36.155014 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:36.352250 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:36.352204 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:36.639870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:36.639780 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:36.930598 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:36.930560 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:37.108977 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.108946 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:37.202886 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.202800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:37.202886 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.202870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:37.203107 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:37.203063 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:37.203167 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:37.203151 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls podName:b17aedc2-4300-4910-8848-fb44c750e94f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:53.203131804 +0000 UTC m=+85.284047173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6rd" (UID: "b17aedc2-4300-4910-8848-fb44c750e94f") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:37.203449 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.203426 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b17aedc2-4300-4910-8848-fb44c750e94f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:37.328806 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.328757 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:37.571188 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:37.571062 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:38.145372 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.145335 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:38.667812 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.667722 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhr8d" event={"ID":"7b657fe4-b60c-4298-b201-3a6d10bb345b","Type":"ContainerStarted","Data":"7f3521c14048254d041bf6c6c00a6033c616bd5e86a387256c37f53e2b0706d0"} Jul 05 13:19:38.669199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.669171 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b584" event={"ID":"a78522ad-9741-4a1e-9490-6722105f8d70","Type":"ContainerStarted","Data":"e5602bfbac142f8760198c1c56bf083c26d08235c7f26bc20aeb3dc2be470c4f"} Jul 05 13:19:38.702398 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.702331 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bhr8d" podStartSLOduration=66.688532965 podStartE2EDuration="1m10.702300025s" totalImagesPullingTime="4.01376706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.701046633 +0000 UTC m=+70.781962020" watchObservedRunningTime="2026-07-05 13:19:38.702300025 +0000 UTC m=+70.783215411" Jul 05 13:19:38.779473 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.779377 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:38.962431 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:38.962365 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:39.407176 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:39.407142 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:39.579663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:39.579621 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:39.673276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:39.673197 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b584" event={"ID":"a78522ad-9741-4a1e-9490-6722105f8d70","Type":"ContainerStarted","Data":"f502a36c2189df8cc9763931b66848dc1f300e745c82562d9b9f6a1004be06b1"} Jul 05 13:19:39.706445 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:39.706401 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8b584" podStartSLOduration=34.223711292 podStartE2EDuration="37.70637162s" totalImagesPullingTime="3.482660328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:39.705923558 +0000 UTC m=+71.786838943" watchObservedRunningTime="2026-07-05 13:19:39.70637162 +0000 UTC m=+71.787287004" Jul 05 13:19:39.950258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:39.950163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:40.611066 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:40.611034 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:40.676524 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:40.676502 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8b584" Jul 05 13:19:41.029312 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:41.029276 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:41.175249 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:41.175218 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:41.320496 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:41.320410 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:42.560423 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:42.560371 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:42.705256 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:42.705226 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.091361 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.091322 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.220716 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.220685 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.324428 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.324396 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.465688 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.465652 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.565243 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.565215 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:43.717629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:43.717562 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:44.507992 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:44.507955 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:44.886037 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:44.885957 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:45.459779 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:45.459734 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:45.560999 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:45.560960 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:45.666359 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:45.666325 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:45.759445 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:45.759325 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:46.117054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:46.116961 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:46.857153 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:46.857119 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:46.946100 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:46.946064 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:48.083285 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.083247 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:48.175619 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.175577 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:48.686101 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.686061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:48.686301 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.686114 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:48.686735 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.686715 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669c8f24-bdb5-4579-8b26-c0c071070684-service-ca-bundle\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:48.688472 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.688451 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669c8f24-bdb5-4579-8b26-c0c071070684-metrics-certs\") pod \"router-default-7c6675b69f-2vscq\" (UID: \"669c8f24-bdb5-4579-8b26-c0c071070684\") " pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:48.696164 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.696134 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:48.826523 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.826493 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:48.961274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.961211 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vpshd\"" Jul 05 13:19:48.969251 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:48.969234 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:49.125133 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.125109 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6675b69f-2vscq"] Jul 05 13:19:49.125957 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:49.125935 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669c8f24_bdb5_4579_8b26_c0c071070684.slice/crio-cf717613e08d6ba04b4fe71e881a38bdc59c672482de9d037727978af2e2ed25 WatchSource:0}: Error finding container cf717613e08d6ba04b4fe71e881a38bdc59c672482de9d037727978af2e2ed25: Status 404 returned error can't find the container with id cf717613e08d6ba04b4fe71e881a38bdc59c672482de9d037727978af2e2ed25 Jul 05 13:19:49.712334 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.712297 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6675b69f-2vscq" event={"ID":"669c8f24-bdb5-4579-8b26-c0c071070684","Type":"ContainerStarted","Data":"ddbf8643688320e2bdc28e3aa2eba81d11eb34cb0550a1141098d27aec2fa925"} Jul 05 13:19:49.712504 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.712374 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6675b69f-2vscq" event={"ID":"669c8f24-bdb5-4579-8b26-c0c071070684","Type":"ContainerStarted","Data":"cf717613e08d6ba04b4fe71e881a38bdc59c672482de9d037727978af2e2ed25"} Jul 05 13:19:49.739240 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.739199 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c6675b69f-2vscq" podStartSLOduration=33.73918501 podStartE2EDuration="33.73918501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:49.739172451 +0000 UTC m=+81.820087847" watchObservedRunningTime="2026-07-05 13:19:49.73918501 +0000 UTC m=+81.820100429" Jul 05 13:19:49.919564 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.919532 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:49.969798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.969688 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:49.972103 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:49.972085 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:50.124418 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.124365 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:50.493881 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.493841 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:50.651396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.651339 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:50.682063 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.682043 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8b584" Jul 05 13:19:50.715341 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.715317 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:50.716412 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.716395 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c6675b69f-2vscq" Jul 05 13:19:50.947853 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:50.947824 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:51.059789 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:51.059754 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:51.145134 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:51.145099 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:51.508435 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:51.508401 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:51.667056 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:51.667027 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:51.745080 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:51.745050 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:52.869741 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:52.869708 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:52.971577 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:52.971544 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:53.215584 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.215554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:53.217770 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.217741 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b17aedc2-4300-4910-8848-fb44c750e94f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6rd\" (UID: \"b17aedc2-4300-4910-8848-fb44c750e94f\") " pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:53.356122 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.356094 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk"] Jul 05 13:19:53.361351 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.361335 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.365743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.365726 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 13:19:53.367059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.367039 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 05 13:19:53.367059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.367053 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 13:19:53.367203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.367061 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 13:19:53.400080 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.400054 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk"] Jul 05 13:19:53.416833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.416810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d944829c-3c47-477d-8214-6dee28047293-tmp\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.416934 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.416839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d944829c-3c47-477d-8214-6dee28047293-klusterlet-config\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.416934 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.416860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b86x2\" (UniqueName: \"kubernetes.io/projected/d944829c-3c47-477d-8214-6dee28047293-kube-api-access-b86x2\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.456826 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.456775 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n6z8z\"" Jul 05 13:19:53.464303 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.464269 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6rd" Jul 05 13:19:53.519253 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.519218 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d944829c-3c47-477d-8214-6dee28047293-tmp\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.519407 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.519272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d944829c-3c47-477d-8214-6dee28047293-klusterlet-config\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.519407 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.519334 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b86x2\" (UniqueName: \"kubernetes.io/projected/d944829c-3c47-477d-8214-6dee28047293-kube-api-access-b86x2\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.522406 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.520137 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d944829c-3c47-477d-8214-6dee28047293-tmp\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.525750 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.525719 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d944829c-3c47-477d-8214-6dee28047293-klusterlet-config\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.531160 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.531138 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-826t4"] Jul 05 13:19:53.537419 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.537402 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:53.541910 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:53.541879 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-z2qr6\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"default-dockercfg-z2qr6\"" type="*v1.Secret" Jul 05 13:19:53.541991 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:53.541942 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 05 13:19:53.541991 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:53.541942 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 05 13:19:53.541991 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:19:53.541960 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"downloads-685bfb5f64-826t4\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="bf491e3b-6725-493f-895d-384c2fb23ef7" pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:53.578000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.577966 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b86x2\" (UniqueName: \"kubernetes.io/projected/d944829c-3c47-477d-8214-6dee28047293-kube-api-access-b86x2\") pod \"klusterlet-addon-workmgr-59fb6d4764-cmmbk\" (UID: \"d944829c-3c47-477d-8214-6dee28047293\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.580272 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.580244 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6"] Jul 05 13:19:53.584167 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.584147 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:19:53.590557 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.590538 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sdmgp\"" Jul 05 13:19:53.601122 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.601105 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 05 13:19:53.620375 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.620351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fpg\" (UniqueName: \"kubernetes.io/projected/bf491e3b-6725-493f-895d-384c2fb23ef7-kube-api-access-p8fpg\") pod \"downloads-685bfb5f64-826t4\" (UID: \"bf491e3b-6725-493f-895d-384c2fb23ef7\") " pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:53.636112 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.636090 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-826t4"] Jul 05 13:19:53.639833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.639813 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6"] Jul 05 13:19:53.670877 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.670856 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:19:53.687032 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.687014 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6rd"] Jul 05 13:19:53.689306 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:53.689287 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17aedc2_4300_4910_8848_fb44c750e94f.slice/crio-ed0696bd056b3695d7c1b5f8539dd9a3733b28c7f8b619e46ef73233a5b54926 WatchSource:0}: Error finding container ed0696bd056b3695d7c1b5f8539dd9a3733b28c7f8b619e46ef73233a5b54926: Status 404 returned error can't find the container with id ed0696bd056b3695d7c1b5f8539dd9a3733b28c7f8b619e46ef73233a5b54926 Jul 05 13:19:53.695215 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.695189 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:53.721368 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.721325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39a99df3-b829-42a0-b772-d1ca5be93f44-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rxrh6\" (UID: \"39a99df3-b829-42a0-b772-d1ca5be93f44\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:19:53.721497 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.721473 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fpg\" (UniqueName: \"kubernetes.io/projected/bf491e3b-6725-493f-895d-384c2fb23ef7-kube-api-access-p8fpg\") pod \"downloads-685bfb5f64-826t4\" (UID: \"bf491e3b-6725-493f-895d-384c2fb23ef7\") " pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:53.725993 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.725951 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6rd" event={"ID":"b17aedc2-4300-4910-8848-fb44c750e94f","Type":"ContainerStarted","Data":"ed0696bd056b3695d7c1b5f8539dd9a3733b28c7f8b619e46ef73233a5b54926"} Jul 05 13:19:53.821926 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.821896 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39a99df3-b829-42a0-b772-d1ca5be93f44-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rxrh6\" (UID: \"39a99df3-b829-42a0-b772-d1ca5be93f44\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:19:53.824043 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.824026 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39a99df3-b829-42a0-b772-d1ca5be93f44-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rxrh6\" (UID: \"39a99df3-b829-42a0-b772-d1ca5be93f44\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:19:53.868020 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.867998 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7689fffb6-drf2d"] Jul 05 13:19:53.872696 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.872682 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.879081 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.879058 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 05 13:19:53.879344 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.879329 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 05 13:19:53.879445 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.879372 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ckkjd\"" Jul 05 13:19:53.880397 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.880365 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 05 13:19:53.883966 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.883949 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 05 13:19:53.892927 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.892911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:19:53.922205 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-bound-sa-token\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922303 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922226 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-ca-trust-extracted\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922303 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-installation-pull-secrets\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922303 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-image-registry-private-configuration\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922422 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922343 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-trusted-ca\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922422 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922370 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-tls\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922503 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-kube-api-access-ctd5n\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.922503 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.922488 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-certificates\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:53.978909 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:53.978455 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7689fffb6-drf2d"] Jul 05 13:19:54.022905 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.022871 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-ca-trust-extracted\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.022911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-installation-pull-secrets\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.022943 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-image-registry-private-configuration\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.022983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-trusted-ca\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-tls\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023272 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-kube-api-access-ctd5n\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023272 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-certificates\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023272 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-bound-sa-token\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023463 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023336 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-ca-trust-extracted\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.023973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.023947 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-trusted-ca\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.024085 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.024058 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-certificates\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.025314 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.025288 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-installation-pull-secrets\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.025437 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.025394 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-registry-tls\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.025437 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.025412 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-image-registry-private-configuration\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.064017 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:54.063992 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd944829c_3c47_477d_8214_6dee28047293.slice/crio-1a75a67c7f3a8582a98def6535c796c2e5f50d0968a73a50544fca8e80af61be WatchSource:0}: Error finding container 1a75a67c7f3a8582a98def6535c796c2e5f50d0968a73a50544fca8e80af61be: Status 404 returned error can't find the container with id 1a75a67c7f3a8582a98def6535c796c2e5f50d0968a73a50544fca8e80af61be Jul 05 13:19:54.069029 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.068983 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk"] Jul 05 13:19:54.126166 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.126123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-bound-sa-token\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.126558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.126500 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/415dee26-48bf-40c3-9bb0-9ee5a49db7ab-kube-api-access-ctd5n\") pod \"image-registry-7689fffb6-drf2d\" (UID: \"415dee26-48bf-40c3-9bb0-9ee5a49db7ab\") " pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.146130 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.146087 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:54.156177 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.156114 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6"] Jul 05 13:19:54.181514 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.181306 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.347338 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.347124 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z2qr6\"" Jul 05 13:19:54.366292 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.365682 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7689fffb6-drf2d"] Jul 05 13:19:54.370106 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:54.370080 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415dee26_48bf_40c3_9bb0_9ee5a49db7ab.slice/crio-d497d594b88d833aff6f2e7c98e1c613532743d007e1cf59d8671b52078932e3 WatchSource:0}: Error finding container d497d594b88d833aff6f2e7c98e1c613532743d007e1cf59d8671b52078932e3: Status 404 returned error can't find the container with id d497d594b88d833aff6f2e7c98e1c613532743d007e1cf59d8671b52078932e3 Jul 05 13:19:54.388254 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.388124 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:54.545840 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.545745 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 05 13:19:54.549130 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.549080 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 05 13:19:54.558468 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.558443 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fpg\" (UniqueName: \"kubernetes.io/projected/bf491e3b-6725-493f-895d-384c2fb23ef7-kube-api-access-p8fpg\") pod \"downloads-685bfb5f64-826t4\" (UID: \"bf491e3b-6725-493f-895d-384c2fb23ef7\") " pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:54.735849 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.735813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" event={"ID":"d944829c-3c47-477d-8214-6dee28047293","Type":"ContainerStarted","Data":"1a75a67c7f3a8582a98def6535c796c2e5f50d0968a73a50544fca8e80af61be"} Jul 05 13:19:54.738325 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.738235 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" event={"ID":"415dee26-48bf-40c3-9bb0-9ee5a49db7ab","Type":"ContainerStarted","Data":"88ac6fe52c8c96d0fe143739d68d470d51579bc4f13fef4647fe91ce21bd6506"} Jul 05 13:19:54.738325 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.738283 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" event={"ID":"415dee26-48bf-40c3-9bb0-9ee5a49db7ab","Type":"ContainerStarted","Data":"d497d594b88d833aff6f2e7c98e1c613532743d007e1cf59d8671b52078932e3"} Jul 05 13:19:54.738952 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.738934 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:19:54.740977 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.740954 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" event={"ID":"39a99df3-b829-42a0-b772-d1ca5be93f44","Type":"ContainerStarted","Data":"30df6d8f5d4d6fb08311d6e4603b181195f689f8045ce2169d00f42026ba8668"} Jul 05 13:19:54.748044 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.748002 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:19:54.784645 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.784591 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" podStartSLOduration=1.784570588 podStartE2EDuration="1.784570588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:54.78353537 +0000 UTC m=+86.864450757" watchObservedRunningTime="2026-07-05 13:19:54.784570588 +0000 UTC m=+86.865485975" Jul 05 13:19:54.945121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:54.945080 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-826t4"] Jul 05 13:19:54.948884 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:19:54.948848 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf491e3b_6725_493f_895d_384c2fb23ef7.slice/crio-8f1d74a2e7be33b0bd7d1148fbfc87c00a381f58ee4fd50618c5fcf23f469307 WatchSource:0}: Error finding container 8f1d74a2e7be33b0bd7d1148fbfc87c00a381f58ee4fd50618c5fcf23f469307: Status 404 returned error can't find the container with id 8f1d74a2e7be33b0bd7d1148fbfc87c00a381f58ee4fd50618c5fcf23f469307 Jul 05 13:19:55.641288 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:55.641145 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:55.750958 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:55.750923 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-826t4" event={"ID":"bf491e3b-6725-493f-895d-384c2fb23ef7","Type":"ContainerStarted","Data":"8f1d74a2e7be33b0bd7d1148fbfc87c00a381f58ee4fd50618c5fcf23f469307"} Jul 05 13:19:55.764820 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:55.764776 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:56.524462 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:56.524413 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:56.594948 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:56.594915 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:58.105475 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:58.105426 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:19:58.170065 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:19:58.170031 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:00.097593 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:00.097487 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:00.197972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:00.197932 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:01.778804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.778744 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" event={"ID":"d944829c-3c47-477d-8214-6dee28047293","Type":"ContainerStarted","Data":"c66c41c95b7bf85774b20c1e2f60d7e9f4ca66a9e0fb8e3195f19ed04b2ca139"} Jul 05 13:20:01.779319 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.779038 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:20:01.780872 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.780845 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" Jul 05 13:20:01.781203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.781168 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" event={"ID":"39a99df3-b829-42a0-b772-d1ca5be93f44","Type":"ContainerStarted","Data":"1b222d36b0099739e4ae8e92f80c4667bd3af22645cdd4082a9a9c865e8d7fb7"} Jul 05 13:20:01.781346 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.781324 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:20:01.783446 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.783422 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6rd" event={"ID":"b17aedc2-4300-4910-8848-fb44c750e94f","Type":"ContainerStarted","Data":"deb4839899a80255623a9d00467e770c9d5e23557d85caf15d1b267803805308"} Jul 05 13:20:01.783585 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.783473 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6rd" event={"ID":"b17aedc2-4300-4910-8848-fb44c750e94f","Type":"ContainerStarted","Data":"036aea1c693608421c24fca479cbafb341d3aeabada2afae00c05c76a55e0308"} Jul 05 13:20:01.786185 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.786165 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" Jul 05 13:20:01.825568 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.825504 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59fb6d4764-cmmbk" podStartSLOduration=2.045459688 podStartE2EDuration="8.825486515s" totalImagesPullingTime="6.780026827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:01.824337184 +0000 UTC m=+93.905252588" watchObservedRunningTime="2026-07-05 13:20:01.825486515 +0000 UTC m=+93.906401899" Jul 05 13:20:01.860440 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:01.860374 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rxrh6" podStartSLOduration=3.761503661 podStartE2EDuration="8.860353466s" totalImagesPullingTime="5.098849805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:01.859133026 +0000 UTC m=+93.940048411" watchObservedRunningTime="2026-07-05 13:20:01.860353466 +0000 UTC m=+93.941268853" Jul 05 13:20:02.356578 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.356525 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:02.417946 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.417913 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm"] Jul 05 13:20:02.421351 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.421324 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.425459 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.425434 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 13:20:02.426101 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.426080 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 13:20:02.426201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.426088 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 13:20:02.426782 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.426763 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6z6qh\"" Jul 05 13:20:02.426884 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.426838 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 05 13:20:02.427045 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.427027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 05 13:20:02.454528 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.454394 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm"] Jul 05 13:20:02.500937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.500905 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52bn7\" (UniqueName: \"kubernetes.io/projected/181119b3-2918-47d2-aa63-8f61c78d15a7-kube-api-access-52bn7\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.501121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.500963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181119b3-2918-47d2-aa63-8f61c78d15a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.501121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.501014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.501121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.501048 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.594438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.594357 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:02.601857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.601828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.602022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.601878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.602022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.601964 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52bn7\" (UniqueName: \"kubernetes.io/projected/181119b3-2918-47d2-aa63-8f61c78d15a7-kube-api-access-52bn7\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.602022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.601998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181119b3-2918-47d2-aa63-8f61c78d15a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.602203 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:20:02.602185 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 05 13:20:02.602272 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:20:02.602260 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls podName:181119b3-2918-47d2-aa63-8f61c78d15a7 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:03.102242035 +0000 UTC m=+95.183157400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-q2clm" (UID: "181119b3-2918-47d2-aa63-8f61c78d15a7") : secret "prometheus-operator-tls" not found Jul 05 13:20:02.602751 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.602727 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181119b3-2918-47d2-aa63-8f61c78d15a7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.605149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.605126 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.620708 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.620643 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52bn7\" (UniqueName: \"kubernetes.io/projected/181119b3-2918-47d2-aa63-8f61c78d15a7-kube-api-access-52bn7\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:02.745012 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:02.744971 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:03.106644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:03.106545 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:03.109628 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:03.109595 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/181119b3-2918-47d2-aa63-8f61c78d15a7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q2clm\" (UID: \"181119b3-2918-47d2-aa63-8f61c78d15a7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:03.333525 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:03.333485 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" Jul 05 13:20:04.723570 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:04.723532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm"] Jul 05 13:20:04.733445 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:20:04.733411 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181119b3_2918_47d2_aa63_8f61c78d15a7.slice/crio-547f4b90837440069a0fd0512a5ef30ee51c93e1b3c370168be73ce97d4be5fe WatchSource:0}: Error finding container 547f4b90837440069a0fd0512a5ef30ee51c93e1b3c370168be73ce97d4be5fe: Status 404 returned error can't find the container with id 547f4b90837440069a0fd0512a5ef30ee51c93e1b3c370168be73ce97d4be5fe Jul 05 13:20:04.800713 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:04.800607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6rd" event={"ID":"b17aedc2-4300-4910-8848-fb44c750e94f","Type":"ContainerStarted","Data":"046f94a76b929842ef08c1a4038abd384600d0f2440ab2528c859f6496fac9d1"} Jul 05 13:20:04.801824 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:04.801798 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" event={"ID":"181119b3-2918-47d2-aa63-8f61c78d15a7","Type":"ContainerStarted","Data":"547f4b90837440069a0fd0512a5ef30ee51c93e1b3c370168be73ce97d4be5fe"} Jul 05 13:20:04.915840 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:04.915774 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qb6rd" podStartSLOduration=33.196399959 podStartE2EDuration="43.915752793s" totalImagesPullingTime="10.719352834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:04.913684672 +0000 UTC m=+96.994600057" watchObservedRunningTime="2026-07-05 13:20:04.915752793 +0000 UTC m=+96.996668179" Jul 05 13:20:05.160420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:05.160217 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:05.412733 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:05.412651 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:05.596631 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:05.596601 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:05.658588 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:05.658557 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xpht5" Jul 05 13:20:07.603856 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:07.603819 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:07.902679 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:07.902644 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:08.097876 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:08.097831 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:09.786041 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:09.785994 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:10.072147 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:10.072065 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:12.833940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:12.833855 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-826t4" event={"ID":"bf491e3b-6725-493f-895d-384c2fb23ef7","Type":"ContainerStarted","Data":"b854f309364c40a938469c8ea98e7e28a8bd16bba2007703dbb37f457cd7839b"} Jul 05 13:20:12.834429 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:12.834069 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:20:12.835709 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:12.835685 2569 patch_prober.go:28] interesting pod/downloads-685bfb5f64-826t4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 05 13:20:12.835826 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:12.835734 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-826t4" podUID="bf491e3b-6725-493f-895d-384c2fb23ef7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 05 13:20:12.870644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:12.870586 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-826t4" podStartSLOduration=2.33021453 podStartE2EDuration="19.87057015s" totalImagesPullingTime="17.54035562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:12.869692499 +0000 UTC m=+104.950607885" watchObservedRunningTime="2026-07-05 13:20:12.87057015 +0000 UTC m=+104.951485535" Jul 05 13:20:13.842707 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:13.842666 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" event={"ID":"181119b3-2918-47d2-aa63-8f61c78d15a7","Type":"ContainerStarted","Data":"c57ca6133693f87ab7255e40328be85f04e5dc919a80ade222d0f3e08bb79992"} Jul 05 13:20:13.843179 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:13.842754 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" event={"ID":"181119b3-2918-47d2-aa63-8f61c78d15a7","Type":"ContainerStarted","Data":"0a867a532217cdafe205c64778134d5494ef89f25818542be28b809532b6cdd2"} Jul 05 13:20:13.845703 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:13.845677 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-826t4" Jul 05 13:20:13.890584 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:13.890520 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q2clm" podStartSLOduration=3.183486597 podStartE2EDuration="11.890498748s" totalImagesPullingTime="8.707012151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:13.890370833 +0000 UTC m=+105.971286257" watchObservedRunningTime="2026-07-05 13:20:13.890498748 +0000 UTC m=+105.971414134" Jul 05 13:20:14.140149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:14.140055 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:15.611256 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:15.611218 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:15.974939 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:15.974889 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:16.120503 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.120468 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kxb6t"] Jul 05 13:20:16.142106 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.142078 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.145947 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.145904 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 13:20:16.146097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.145999 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8xvgv\"" Jul 05 13:20:16.146363 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.146341 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 13:20:16.147042 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.147018 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 13:20:16.253591 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.253508 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:16.317121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317309 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-metrics-client-ca\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317309 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-sys\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317309 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-wtmp\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317497 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317317 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-root\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317497 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rbrv\" (UniqueName: \"kubernetes.io/projected/0eb81c05-5065-4029-9507-a5cc1db357fe-kube-api-access-2rbrv\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-textfile\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-tls\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.317632 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.317570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418480 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-root\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418514 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rbrv\" (UniqueName: \"kubernetes.io/projected/0eb81c05-5065-4029-9507-a5cc1db357fe-kube-api-access-2rbrv\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-textfile\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-tls\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418599 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-root\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418625 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.418739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418707 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-metrics-client-ca\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-sys\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-wtmp\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418862 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-sys\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418923 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-wtmp\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.418988 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-textfile\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419523 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.419495 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.419650 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.419531 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb81c05-5065-4029-9507-a5cc1db357fe-metrics-client-ca\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.421434 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.421410 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-tls\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.421545 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.421442 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eb81c05-5065-4029-9507-a5cc1db357fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.436075 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.436050 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rbrv\" (UniqueName: \"kubernetes.io/projected/0eb81c05-5065-4029-9507-a5cc1db357fe-kube-api-access-2rbrv\") pod \"node-exporter-kxb6t\" (UID: \"0eb81c05-5065-4029-9507-a5cc1db357fe\") " pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.451900 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.451874 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxb6t" Jul 05 13:20:16.505284 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:20:16.505145 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb81c05_5065_4029_9507_a5cc1db357fe.slice/crio-1476f9c7677b39bd0099f3566ece7fb9a33cdcca9ab43ec7dd1db42f27a6d308 WatchSource:0}: Error finding container 1476f9c7677b39bd0099f3566ece7fb9a33cdcca9ab43ec7dd1db42f27a6d308: Status 404 returned error can't find the container with id 1476f9c7677b39bd0099f3566ece7fb9a33cdcca9ab43ec7dd1db42f27a6d308 Jul 05 13:20:16.622658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.622612 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:16.760685 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.760617 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7689fffb6-drf2d" Jul 05 13:20:16.857926 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:16.857890 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxb6t" event={"ID":"0eb81c05-5065-4029-9507-a5cc1db357fe","Type":"ContainerStarted","Data":"1476f9c7677b39bd0099f3566ece7fb9a33cdcca9ab43ec7dd1db42f27a6d308"} Jul 05 13:20:17.173734 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.173612 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:17.269824 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.269786 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:20:17.304365 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.304327 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:20:17.304559 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.304485 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.310645 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.310615 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 13:20:17.310803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.310661 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 13:20:17.310803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.310673 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 13:20:17.311143 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.311118 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 13:20:17.312020 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.312000 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 13:20:17.312199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.312134 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 13:20:17.312199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.312177 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 13:20:17.312431 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.312415 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 13:20:17.312689 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.312619 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-glcc6\"" Jul 05 13:20:17.317550 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.317527 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 13:20:17.352937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.352908 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:17.428646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.428561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.428646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.428597 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.428646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.428633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429092 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.428890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429092 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.428962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429092 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429092 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429142 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fn5\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429257 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.429367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.429328 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.439997 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.439885 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:17.530463 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530423 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.530668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.530668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.530668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530581 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.530668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.530668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.530635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fn5\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.531276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.531100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.531276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.531161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.531276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.531203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.531276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.531236 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.534799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.531729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.534799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.535931 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.534799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.536190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.534799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.536733 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.545748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.543979 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.545748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.544030 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.545748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.544079 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.549618 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.549598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.550951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.550653 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.552892 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.552851 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:17.553206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.553148 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.553610 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.553591 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.554624 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.554574 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.555287 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.555265 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.556887 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.556862 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.557377 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.557352 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.558223 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.558200 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fn5\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5\") pod \"alertmanager-main-0\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.618054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.618018 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:20:17.641788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.641743 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:17.879226 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:17.879094 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:20:17.885365 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:20:17.885317 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b0b1a2_b123_4878_adc8_3551f596bd08.slice/crio-d90bfbedad1f5c1dbc2f1e7cea73ef9e592ff898bb51e54d07673b6f43804c63 WatchSource:0}: Error finding container d90bfbedad1f5c1dbc2f1e7cea73ef9e592ff898bb51e54d07673b6f43804c63: Status 404 returned error can't find the container with id d90bfbedad1f5c1dbc2f1e7cea73ef9e592ff898bb51e54d07673b6f43804c63 Jul 05 13:20:18.869450 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:18.869266 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"d90bfbedad1f5c1dbc2f1e7cea73ef9e592ff898bb51e54d07673b6f43804c63"} Jul 05 13:20:18.871538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:18.871493 2569 generic.go:356] "Generic (PLEG): container finished" podID="0eb81c05-5065-4029-9507-a5cc1db357fe" containerID="da99128e8cc3af01343d99548368f38cba3ca62b96a6903518fc5513c40e09ed" exitCode=0 Jul 05 13:20:18.871674 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:18.871541 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxb6t" event={"ID":"0eb81c05-5065-4029-9507-a5cc1db357fe","Type":"ContainerDied","Data":"da99128e8cc3af01343d99548368f38cba3ca62b96a6903518fc5513c40e09ed"} Jul 05 13:20:19.009216 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.009186 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:19.116568 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.116536 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:19.162454 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.162420 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-659c654ccc-njdst"] Jul 05 13:20:19.178255 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.178227 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.183450 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.183424 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 05 13:20:19.184141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184116 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 05 13:20:19.184141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184137 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9f81hi2qqbduv\"" Jul 05 13:20:19.184321 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184298 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 05 13:20:19.184455 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184360 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nd9gf\"" Jul 05 13:20:19.184533 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184516 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 05 13:20:19.184595 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.184573 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 05 13:20:19.198739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.198709 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-659c654ccc-njdst"] Jul 05 13:20:19.238263 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.238228 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:19.256942 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.256915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.256961 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.256996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.257023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.257059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-grpc-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.257147 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.257211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t9lz\" (UniqueName: \"kubernetes.io/projected/a4b85918-cd3d-43a9-afd9-734f9157167f-kube-api-access-8t9lz\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.257258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.257244 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b85918-cd3d-43a9-afd9-734f9157167f-metrics-client-ca\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358584 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t9lz\" (UniqueName: \"kubernetes.io/projected/a4b85918-cd3d-43a9-afd9-734f9157167f-kube-api-access-8t9lz\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358744 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b85918-cd3d-43a9-afd9-734f9157167f-metrics-client-ca\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358744 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358744 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358699 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358780 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-grpc-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.358907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.358858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.360402 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.360359 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b85918-cd3d-43a9-afd9-734f9157167f-metrics-client-ca\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.361774 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.361731 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.362362 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.362337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.362489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.362363 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.362635 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.362598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.362866 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.362849 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.363711 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.363692 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4b85918-cd3d-43a9-afd9-734f9157167f-secret-grpc-tls\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.368951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.368929 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t9lz\" (UniqueName: \"kubernetes.io/projected/a4b85918-cd3d-43a9-afd9-734f9157167f-kube-api-access-8t9lz\") pod \"thanos-querier-659c654ccc-njdst\" (UID: \"a4b85918-cd3d-43a9-afd9-734f9157167f\") " pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.491260 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.491225 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:19.557050 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.557009 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:19.670458 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.670421 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-659c654ccc-njdst"] Jul 05 13:20:19.675435 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:20:19.675405 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b85918_cd3d_43a9_afd9_734f9157167f.slice/crio-5648ab0dc6ca3a37bff749cedaadf4444992cb2f17c497b57b8c519eae6bb4ed WatchSource:0}: Error finding container 5648ab0dc6ca3a37bff749cedaadf4444992cb2f17c497b57b8c519eae6bb4ed: Status 404 returned error can't find the container with id 5648ab0dc6ca3a37bff749cedaadf4444992cb2f17c497b57b8c519eae6bb4ed Jul 05 13:20:19.877584 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.877540 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583" exitCode=0 Jul 05 13:20:19.878046 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.877635 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583"} Jul 05 13:20:19.879316 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.879291 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"5648ab0dc6ca3a37bff749cedaadf4444992cb2f17c497b57b8c519eae6bb4ed"} Jul 05 13:20:19.881935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.881850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxb6t" event={"ID":"0eb81c05-5065-4029-9507-a5cc1db357fe","Type":"ContainerStarted","Data":"d390bc322a34bd41a486c5696fb17fc25281570783f0dc2f693bf77909877d63"} Jul 05 13:20:19.881935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.881901 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxb6t" event={"ID":"0eb81c05-5065-4029-9507-a5cc1db357fe","Type":"ContainerStarted","Data":"0e6703f76070c7d30bd7057830796cf79ea1611fc2d5dcb5efcbed837d8e5d5c"} Jul 05 13:20:19.938255 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:19.938166 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kxb6t" podStartSLOduration=2.252816478 podStartE2EDuration="3.938145601s" totalImagesPullingTime="1.588041225s" totalInitContainerRuntime="97.287898ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:19.937104501 +0000 UTC m=+112.018019898" watchObservedRunningTime="2026-07-05 13:20:19.938145601 +0000 UTC m=+112.019060987" Jul 05 13:20:20.222023 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.221908 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:20.412647 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.412610 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:20.613263 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.613152 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:20.707777 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.707523 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:20.812689 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.812650 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:20.915439 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:20.915339 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:21.040281 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:21.040199 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:21.140943 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:21.140905 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:22.320800 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.320760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:22.602649 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.602617 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:22.704844 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.704813 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:22.897001 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.896976 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3"} Jul 05 13:20:22.897132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.897039 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b"} Jul 05 13:20:22.897132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.897075 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd"} Jul 05 13:20:22.898937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.898913 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"7b64cab8a9bda1cde2fdcd438231a6702322d24cd438521671c69f040e41d790"} Jul 05 13:20:22.899032 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.898968 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"87480b5665fd76b0be79559b89d9a33d9c57518f09ee503526893f50732018a0"} Jul 05 13:20:22.899032 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:22.898997 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"2e86d1354573fbad56869489892d388aece845fdaf63281ed514c288959a9d07"} Jul 05 13:20:23.905776 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:23.905738 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4"} Jul 05 13:20:23.906214 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:23.905818 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43"} Jul 05 13:20:24.912971 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.912936 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerStarted","Data":"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc"} Jul 05 13:20:24.915668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.915632 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"befd467dc908c7c9419a86fea735105a5d8edb06998715df28ac1357f01f0350"} Jul 05 13:20:24.915799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.915701 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"660240d1007ab1c3daddedcbaf70b12d55a3d9ec36d339d72ae92d1c285ae9c8"} Jul 05 13:20:24.915799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.915732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" event={"ID":"a4b85918-cd3d-43a9-afd9-734f9157167f","Type":"ContainerStarted","Data":"2f818e384dd6f0345e279f18a593e10b167b8dc6ef5eb565d0036f451afaf87c"} Jul 05 13:20:24.915799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.915774 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:24.943315 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.943270 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.721018795 podStartE2EDuration="7.943251143s" totalImagesPullingTime="5.203959426s" totalInitContainerRuntime="18.272922ms" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:24.941292867 +0000 UTC m=+117.022208252" watchObservedRunningTime="2026-07-05 13:20:24.943251143 +0000 UTC m=+117.024166530" Jul 05 13:20:24.965810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:24.965759 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" podStartSLOduration=1.7464500429999998 podStartE2EDuration="5.965738574s" totalImagesPullingTime="4.219288531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:24.965499179 +0000 UTC m=+117.046414564" watchObservedRunningTime="2026-07-05 13:20:24.965738574 +0000 UTC m=+117.046653962" Jul 05 13:20:28.526482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:28.526439 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:28.626952 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:28.626915 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:28.728484 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:28.728446 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:28.916932 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:28.916903 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:28.992928 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:28.992885 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:30.927117 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:30.927086 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-659c654ccc-njdst" Jul 05 13:20:31.537537 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:31.537491 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:31.617251 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:31.617206 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:31.738165 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:31.738120 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:31.838677 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:31.838581 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:31.939304 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:31.939274 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:36.005991 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:36.005953 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:36.067872 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:36.067832 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:38.218919 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.218883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:20:38.221136 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.221104 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff50a7e-13d6-4fc4-954d-0a7051d32608-metrics-certs\") pod \"network-metrics-daemon-rgr2m\" (UID: \"9ff50a7e-13d6-4fc4-954d-0a7051d32608\") " pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:20:38.237861 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.237840 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7qg\"" Jul 05 13:20:38.245181 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.245163 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgr2m" Jul 05 13:20:38.402002 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.401893 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgr2m"] Jul 05 13:20:38.404459 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:20:38.404436 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff50a7e_13d6_4fc4_954d_0a7051d32608.slice/crio-ebec272b273a6ebefaefd9cd2fe1de123cb820a6ee620fef887f141c49b471b5 WatchSource:0}: Error finding container ebec272b273a6ebefaefd9cd2fe1de123cb820a6ee620fef887f141c49b471b5: Status 404 returned error can't find the container with id ebec272b273a6ebefaefd9cd2fe1de123cb820a6ee620fef887f141c49b471b5 Jul 05 13:20:38.971400 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:38.971352 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgr2m" event={"ID":"9ff50a7e-13d6-4fc4-954d-0a7051d32608","Type":"ContainerStarted","Data":"ebec272b273a6ebefaefd9cd2fe1de123cb820a6ee620fef887f141c49b471b5"} Jul 05 13:20:39.511429 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:39.511377 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:39.978165 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:39.978093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgr2m" event={"ID":"9ff50a7e-13d6-4fc4-954d-0a7051d32608","Type":"ContainerStarted","Data":"2850b36c754feeec948ba4c94eb72c472b92827c1eccfedcf5bb3db7c69c18c3"} Jul 05 13:20:40.982940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:40.982903 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgr2m" event={"ID":"9ff50a7e-13d6-4fc4-954d-0a7051d32608","Type":"ContainerStarted","Data":"b0190aba00a5f4d94c41ecefa06f56c81276b1117687f825cb723452cb16e2ce"} Jul 05 13:20:41.001508 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:41.001465 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rgr2m" podStartSLOduration=131.639420147 podStartE2EDuration="2m13.001451172s" totalImagesPullingTime="1.362031025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:40.999668639 +0000 UTC m=+133.080584042" watchObservedRunningTime="2026-07-05 13:20:41.001451172 +0000 UTC m=+133.082366557" Jul 05 13:20:41.095141 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:41.095094 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:41.161235 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:41.161193 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:51.003935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:51.003893 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:20:51.060823 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:20:51.060787 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:35.303340 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:35.303299 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:35.568172 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:35.568090 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:36.371075 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371039 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:36.371475 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371345 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="alertmanager" containerID="cri-o://fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" gracePeriod=120 Jul 05 13:21:36.371475 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371429 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-metric" containerID="cri-o://cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" gracePeriod=120 Jul 05 13:21:36.371608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371454 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy" containerID="cri-o://a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" gracePeriod=120 Jul 05 13:21:36.371608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371477 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="config-reloader" containerID="cri-o://8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" gracePeriod=120 Jul 05 13:21:36.371608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371499 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="prom-label-proxy" containerID="cri-o://acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" gracePeriod=120 Jul 05 13:21:36.371608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:36.371429 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-web" containerID="cri-o://f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" gracePeriod=120 Jul 05 13:21:37.205582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205543 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" exitCode=0 Jul 05 13:21:37.205582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205570 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" exitCode=0 Jul 05 13:21:37.205582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205580 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" exitCode=0 Jul 05 13:21:37.205582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205587 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" exitCode=0 Jul 05 13:21:37.205875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205612 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc"} Jul 05 13:21:37.205875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205699 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43"} Jul 05 13:21:37.205875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205727 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b"} Jul 05 13:21:37.205875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.205751 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd"} Jul 05 13:21:37.626823 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.626800 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:37.671810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671787 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.671962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671848 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.671962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671878 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.671962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671912 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671962 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.671994 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672018 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672042 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672071 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44fn5\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672105 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672128 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672530 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672160 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672530 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672213 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db\") pod \"d6b0b1a2-b123-4878-adc8-3551f596bd08\" (UID: \"d6b0b1a2-b123-4878-adc8-3551f596bd08\") " Jul 05 13:21:37.672726 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672684 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:21:37.672803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.672731 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:21:37.673146 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.673118 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:21:37.674853 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.674823 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:21:37.675080 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.675034 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.675080 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.675041 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out" (OuterVolumeSpecName: "config-out") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:21:37.676842 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.676805 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.676842 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.676825 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume" (OuterVolumeSpecName: "config-volume") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.677075 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.677046 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.677204 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.677175 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.678235 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.678206 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5" (OuterVolumeSpecName: "kube-api-access-44fn5") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "kube-api-access-44fn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:21:37.682750 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.682723 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.689364 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.689339 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config" (OuterVolumeSpecName: "web-config") pod "d6b0b1a2-b123-4878-adc8-3551f596bd08" (UID: "d6b0b1a2-b123-4878-adc8-3551f596bd08"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773514 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773537 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773548 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773556 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773566 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b0b1a2-b123-4878-adc8-3551f596bd08-metrics-client-ca\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773575 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-tls-assets\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773582 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773583 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-volume\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773591 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44fn5\" (UniqueName: \"kubernetes.io/projected/d6b0b1a2-b123-4878-adc8-3551f596bd08-kube-api-access-44fn5\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773619 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-web-config\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773627 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-cluster-tls-config\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773636 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b0b1a2-b123-4878-adc8-3551f596bd08-secret-alertmanager-main-tls\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773644 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-alertmanager-main-db\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:37.773865 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:37.773652 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b0b1a2-b123-4878-adc8-3551f596bd08-config-out\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:21:38.212353 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212319 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" exitCode=0 Jul 05 13:21:38.212353 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212343 2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerID="f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" exitCode=0 Jul 05 13:21:38.212606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212411 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4"} Jul 05 13:21:38.212606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212428 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.212606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212481 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3"} Jul 05 13:21:38.212606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212509 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b0b1a2-b123-4878-adc8-3551f596bd08","Type":"ContainerDied","Data":"d90bfbedad1f5c1dbc2f1e7cea73ef9e592ff898bb51e54d07673b6f43804c63"} Jul 05 13:21:38.212606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.212539 2569 scope.go:117] "RemoveContainer" containerID="acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" Jul 05 13:21:38.220646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.220620 2569 scope.go:117] "RemoveContainer" containerID="cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" Jul 05 13:21:38.227824 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.227810 2569 scope.go:117] "RemoveContainer" containerID="a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" Jul 05 13:21:38.234031 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.234014 2569 scope.go:117] "RemoveContainer" containerID="f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" Jul 05 13:21:38.240278 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.240265 2569 scope.go:117] "RemoveContainer" containerID="8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" Jul 05 13:21:38.242437 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.242418 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:38.247626 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.247611 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:38.247686 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.247673 2569 scope.go:117] "RemoveContainer" containerID="fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" Jul 05 13:21:38.254424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.254403 2569 scope.go:117] "RemoveContainer" containerID="7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583" Jul 05 13:21:38.261475 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.261453 2569 scope.go:117] "RemoveContainer" containerID="acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" Jul 05 13:21:38.261738 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.261719 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc\": container with ID starting with acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc not found: ID does not exist" containerID="acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" Jul 05 13:21:38.261788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.261746 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc"} err="failed to get container status \"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc\": rpc error: code = NotFound desc = could not find container \"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc\": container with ID starting with acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc not found: ID does not exist" Jul 05 13:21:38.261788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.261775 2569 scope.go:117] "RemoveContainer" containerID="cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" Jul 05 13:21:38.262017 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.261997 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4\": container with ID starting with cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4 not found: ID does not exist" containerID="cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" Jul 05 13:21:38.262097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262023 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4"} err="failed to get container status \"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4\": rpc error: code = NotFound desc = could not find container \"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4\": container with ID starting with cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4 not found: ID does not exist" Jul 05 13:21:38.262097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262038 2569 scope.go:117] "RemoveContainer" containerID="a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" Jul 05 13:21:38.262265 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.262247 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43\": container with ID starting with a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43 not found: ID does not exist" containerID="a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" Jul 05 13:21:38.262332 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262274 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43"} err="failed to get container status \"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43\": rpc error: code = NotFound desc = could not find container \"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43\": container with ID starting with a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43 not found: ID does not exist" Jul 05 13:21:38.262332 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262297 2569 scope.go:117] "RemoveContainer" containerID="f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" Jul 05 13:21:38.262529 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.262514 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3\": container with ID starting with f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3 not found: ID does not exist" containerID="f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" Jul 05 13:21:38.262590 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262536 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3"} err="failed to get container status \"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3\": rpc error: code = NotFound desc = could not find container \"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3\": container with ID starting with f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3 not found: ID does not exist" Jul 05 13:21:38.262590 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262557 2569 scope.go:117] "RemoveContainer" containerID="8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" Jul 05 13:21:38.262806 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.262790 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b\": container with ID starting with 8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b not found: ID does not exist" containerID="8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" Jul 05 13:21:38.262841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262810 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b"} err="failed to get container status \"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b\": rpc error: code = NotFound desc = could not find container \"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b\": container with ID starting with 8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b not found: ID does not exist" Jul 05 13:21:38.262841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.262824 2569 scope.go:117] "RemoveContainer" containerID="fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" Jul 05 13:21:38.263043 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.263027 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd\": container with ID starting with fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd not found: ID does not exist" containerID="fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" Jul 05 13:21:38.263108 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263049 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd"} err="failed to get container status \"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd\": rpc error: code = NotFound desc = could not find container \"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd\": container with ID starting with fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd not found: ID does not exist" Jul 05 13:21:38.263108 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263067 2569 scope.go:117] "RemoveContainer" containerID="7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583" Jul 05 13:21:38.263282 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:21:38.263267 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583\": container with ID starting with 7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583 not found: ID does not exist" containerID="7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583" Jul 05 13:21:38.263345 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263290 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583"} err="failed to get container status \"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583\": rpc error: code = NotFound desc = could not find container \"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583\": container with ID starting with 7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583 not found: ID does not exist" Jul 05 13:21:38.263345 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263308 2569 scope.go:117] "RemoveContainer" containerID="acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc" Jul 05 13:21:38.263521 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263504 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc"} err="failed to get container status \"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc\": rpc error: code = NotFound desc = could not find container \"acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc\": container with ID starting with acec109bd8edc53b2f302541df9c6b6c2898bb3757b50caf34d175ed4da7c7fc not found: ID does not exist" Jul 05 13:21:38.263566 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263522 2569 scope.go:117] "RemoveContainer" containerID="cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4" Jul 05 13:21:38.263741 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263726 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4"} err="failed to get container status \"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4\": rpc error: code = NotFound desc = could not find container \"cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4\": container with ID starting with cc9a034c844e68d7d3410acdf74795283622ac2451625a204ac235d838353fa4 not found: ID does not exist" Jul 05 13:21:38.263793 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263742 2569 scope.go:117] "RemoveContainer" containerID="a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43" Jul 05 13:21:38.263936 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263920 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43"} err="failed to get container status \"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43\": rpc error: code = NotFound desc = could not find container \"a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43\": container with ID starting with a121e047b50c875458754d37b924b92c557500b5cfe66c8269db64723b33de43 not found: ID does not exist" Jul 05 13:21:38.263974 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.263937 2569 scope.go:117] "RemoveContainer" containerID="f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3" Jul 05 13:21:38.264117 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264098 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3"} err="failed to get container status \"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3\": rpc error: code = NotFound desc = could not find container \"f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3\": container with ID starting with f8079fb3ea3dffbfb46013d84e807d46b236affe3556b266117b7ed7a52939d3 not found: ID does not exist" Jul 05 13:21:38.264157 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264118 2569 scope.go:117] "RemoveContainer" containerID="8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b" Jul 05 13:21:38.264315 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264299 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b"} err="failed to get container status \"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b\": rpc error: code = NotFound desc = could not find container \"8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b\": container with ID starting with 8f11e73934fadc992bd4c7568586e47866f758a7e322a6eb648128d13ec4629b not found: ID does not exist" Jul 05 13:21:38.264368 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264316 2569 scope.go:117] "RemoveContainer" containerID="fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd" Jul 05 13:21:38.264532 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264512 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd"} err="failed to get container status \"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd\": rpc error: code = NotFound desc = could not find container \"fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd\": container with ID starting with fe9753f2411371bcd41c5d54bf85d7626eb50f80452147005a9306f42e3700dd not found: ID does not exist" Jul 05 13:21:38.264532 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264528 2569 scope.go:117] "RemoveContainer" containerID="7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583" Jul 05 13:21:38.264721 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.264704 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583"} err="failed to get container status \"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583\": rpc error: code = NotFound desc = could not find container \"7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583\": container with ID starting with 7855e17aa21273699b9d860fded613749d69f0421653dd4c14d2570449090583 not found: ID does not exist" Jul 05 13:21:38.279518 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279499 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:38.279764 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279752 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-web" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279765 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-web" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279775 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-metric" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279781 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-metric" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279791 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="init-config-reloader" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279796 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="init-config-reloader" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279804 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="alertmanager" Jul 05 13:21:38.279808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279810 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="alertmanager" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279818 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="config-reloader" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279824 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="config-reloader" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279834 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="prom-label-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279840 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="prom-label-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279847 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279852 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279899 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="prom-label-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279906 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279912 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-web" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279917 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="kube-rbac-proxy-metric" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279923 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="alertmanager" Jul 05 13:21:38.280000 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.279928 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" containerName="config-reloader" Jul 05 13:21:38.283241 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.283220 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.286236 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286216 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 05 13:21:38.286332 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286222 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-glcc6\"" Jul 05 13:21:38.286581 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286563 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 05 13:21:38.286665 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286582 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 05 13:21:38.286760 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286728 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 05 13:21:38.286860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286758 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 05 13:21:38.286923 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286860 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 05 13:21:38.287003 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.286955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 05 13:21:38.287087 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.287071 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 05 13:21:38.292194 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.292172 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 05 13:21:38.299110 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.299088 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:38.376588 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376597 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.376996 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.376990 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgrwv\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-kube-api-access-dgrwv\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.413653 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.413625 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b0b1a2-b123-4878-adc8-3551f596bd08" path="/var/lib/kubelet/pods/d6b0b1a2-b123-4878-adc8-3551f596bd08/volumes" Jul 05 13:21:38.477826 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.477778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.477826 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.477808 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.477933 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.477827 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.477933 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.477844 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478009 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.477979 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478026 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478154 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478073 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgrwv\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-kube-api-access-dgrwv\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478154 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478154 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478154 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478151 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478335 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.478335 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.478244 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.479225 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.479200 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.480827 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.480802 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-out\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.480930 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.480842 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.480930 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.480916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-web-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.481037 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.480975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.481127 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.481107 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.481216 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.481168 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.481216 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.481188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.481590 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.481567 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.482206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.482184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.482268 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.482186 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.482833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.482816 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.486635 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.486618 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgrwv\" (UniqueName: \"kubernetes.io/projected/7dd8a8ac-e5fc-4f25-8d88-17dee0df93af-kube-api-access-dgrwv\") pod \"alertmanager-main-0\" (UID: \"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.594008 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.593979 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 05 13:21:38.726687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:38.726635 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 05 13:21:38.728699 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:21:38.728644 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd8a8ac_e5fc_4f25_8d88_17dee0df93af.slice/crio-8eccb890471e087c9ac63d5bc56ab9e39aac1a774199eb5fae1c6552f08a61c8 WatchSource:0}: Error finding container 8eccb890471e087c9ac63d5bc56ab9e39aac1a774199eb5fae1c6552f08a61c8: Status 404 returned error can't find the container with id 8eccb890471e087c9ac63d5bc56ab9e39aac1a774199eb5fae1c6552f08a61c8 Jul 05 13:21:39.218082 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:39.218050 2569 generic.go:356] "Generic (PLEG): container finished" podID="7dd8a8ac-e5fc-4f25-8d88-17dee0df93af" containerID="c2363690bacb32a2479ad41d22522dab0f957f0aada0f6fb5aaab2b762106c80" exitCode=0 Jul 05 13:21:39.218252 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:39.218106 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerDied","Data":"c2363690bacb32a2479ad41d22522dab0f957f0aada0f6fb5aaab2b762106c80"} Jul 05 13:21:39.218252 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:39.218156 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"8eccb890471e087c9ac63d5bc56ab9e39aac1a774199eb5fae1c6552f08a61c8"} Jul 05 13:21:40.225396 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225355 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"06f051cf88d9b0c1051b09b77b0b1bc098aa2a4456a048101e20e5503b329757"} Jul 05 13:21:40.225841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"791be22f33655283cdb74c66374560bbba13f45d567398b06a0693e477a053f1"} Jul 05 13:21:40.225841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225467 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"1e8a566f20997313eec2bc31cbe6d1d619e3f9bafe66921667c1f4e4212c495f"} Jul 05 13:21:40.225841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225498 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"53baabf853cceff6b9d6d446c0373702d085282d04d805f7135098ccf507ab2f"} Jul 05 13:21:40.225841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225553 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"d9f9c2be25c03c1805406fa6d794030b4c9740dced2ecd300b1412d748adfa09"} Jul 05 13:21:40.225841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.225583 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dd8a8ac-e5fc-4f25-8d88-17dee0df93af","Type":"ContainerStarted","Data":"6d5f37d9fdd36b12f52f7e46bc6c0116ac750de724cf6eaefdfd2f178979a7a8"} Jul 05 13:21:40.255175 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.255116 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.238880165 podStartE2EDuration="2.255102569s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.222404ms" isStatefulPod=false podCreationTimestamp="2026-07-05 13:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:21:40.254603177 +0000 UTC m=+192.335518577" watchObservedRunningTime="2026-07-05 13:21:40.255102569 +0000 UTC m=+192.336017956" Jul 05 13:21:40.386158 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.386125 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bbb9674d-t9j9k"] Jul 05 13:21:40.388569 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.388545 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.391347 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.391327 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 05 13:21:40.391702 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.391676 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 05 13:21:40.391702 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.391679 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p57qs\"" Jul 05 13:21:40.391844 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.391759 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 05 13:21:40.392831 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.392813 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 05 13:21:40.392933 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.392844 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 05 13:21:40.397193 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.397172 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 05 13:21:40.403124 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.403103 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbb9674d-t9j9k"] Jul 05 13:21:40.494629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494581 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-metrics-client-ca\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-serving-certs-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpjt8\" (UniqueName: \"kubernetes.io/projected/428dbac2-b810-42ba-ac4d-92c4566da9b8-kube-api-access-gpjt8\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494680 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494807 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.494860 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.494846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-federate-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595761 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpjt8\" (UniqueName: \"kubernetes.io/projected/428dbac2-b810-42ba-ac4d-92c4566da9b8-kube-api-access-gpjt8\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595761 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595766 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595801 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-federate-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595925 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-metrics-client-ca\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.595970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.595953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-serving-certs-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.596862 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.596711 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-serving-certs-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.596862 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.596735 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-metrics-client-ca\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.597093 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.597071 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.598788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.598749 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.598946 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.598926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-federate-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.599016 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.598926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-secret-telemeter-client\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.599204 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.599184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/428dbac2-b810-42ba-ac4d-92c4566da9b8-telemeter-client-tls\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.605725 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.605700 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpjt8\" (UniqueName: \"kubernetes.io/projected/428dbac2-b810-42ba-ac4d-92c4566da9b8-kube-api-access-gpjt8\") pod \"telemeter-client-7bbb9674d-t9j9k\" (UID: \"428dbac2-b810-42ba-ac4d-92c4566da9b8\") " pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.700679 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.700648 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" Jul 05 13:21:40.850069 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:40.850040 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbb9674d-t9j9k"] Jul 05 13:21:40.852176 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:21:40.852149 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428dbac2_b810_42ba_ac4d_92c4566da9b8.slice/crio-4a0285d788a36703202561380a3decddaf7685aa49e764cacac8a140c54e5944 WatchSource:0}: Error finding container 4a0285d788a36703202561380a3decddaf7685aa49e764cacac8a140c54e5944: Status 404 returned error can't find the container with id 4a0285d788a36703202561380a3decddaf7685aa49e764cacac8a140c54e5944 Jul 05 13:21:41.233789 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:41.233750 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" event={"ID":"428dbac2-b810-42ba-ac4d-92c4566da9b8","Type":"ContainerStarted","Data":"4a0285d788a36703202561380a3decddaf7685aa49e764cacac8a140c54e5944"} Jul 05 13:21:43.243604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:43.243567 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" event={"ID":"428dbac2-b810-42ba-ac4d-92c4566da9b8","Type":"ContainerStarted","Data":"bcf9734caf9230adc7a0ad877c472d5e9924cacbc6c520c9e01a12aad10de166"} Jul 05 13:21:43.243949 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:43.243634 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" event={"ID":"428dbac2-b810-42ba-ac4d-92c4566da9b8","Type":"ContainerStarted","Data":"0b8dbddea6fff8e33db11b0dd0abe719e0237bcf17a61491d5d0527b28004cd8"} Jul 05 13:21:43.243949 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:43.243663 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" event={"ID":"428dbac2-b810-42ba-ac4d-92c4566da9b8","Type":"ContainerStarted","Data":"c2b675319d45e67130effe4d34728da4689efc919c0b221824ce5c8cf6f61b5c"} Jul 05 13:21:43.278027 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:43.277977 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bbb9674d-t9j9k" podStartSLOduration=1.8859500059999998 podStartE2EDuration="3.277960542s" totalImagesPullingTime="1.392010536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:21:43.275276935 +0000 UTC m=+195.356192339" watchObservedRunningTime="2026-07-05 13:21:43.277960542 +0000 UTC m=+195.358875926" Jul 05 13:21:44.059395 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:44.059354 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:44.160885 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:44.160839 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:51.718893 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:51.718857 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:51.780482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:51.780443 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:55.031495 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:55.031453 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:55.132322 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:55.132286 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:21:55.190707 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:21:55.190676 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:21.519179 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:21.519143 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:50.652966 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:50.652883 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:50.751160 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:50.751102 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:54.420672 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:54.420638 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:54.515058 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:54.515019 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:54.611874 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:54.611838 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:22:55.136522 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:22:55.136486 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:02.598144 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:02.598106 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:02.698543 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:02.698503 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:05.314442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:05.314407 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:05.414717 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:05.414683 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:06.025809 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:06.025773 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:06.125246 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:06.125217 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:23:28.290327 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:28.290289 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 13:23:48.801305 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:23:48.801256 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:01.635858 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:01.635823 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:01.825424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:01.825369 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:29.480833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:29.480749 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:29.891614 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:29.891521 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:33.936029 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:33.935988 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:34.150863 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:34.150827 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:35.900249 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:35.900215 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:36.075564 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:36.075527 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:36.466774 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:36.466744 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:36.719118 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:36.719033 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:38.784411 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:38.784356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:39.089558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:39.089469 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:40.021438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.021405 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nds6n"] Jul 05 13:24:40.024633 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.024616 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.028323 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.028302 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 13:24:40.028509 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.028489 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p2rsx\"" Jul 05 13:24:40.029297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.029274 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 13:24:40.041133 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.041109 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nds6n"] Jul 05 13:24:40.171140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.171104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.171310 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.171146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sspfb\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-kube-api-access-sspfb\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.272637 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.272554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.272637 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.272593 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sspfb\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-kube-api-access-sspfb\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.286328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.286304 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.291846 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.291824 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sspfb\" (UniqueName: \"kubernetes.io/projected/6bd24f2e-fe77-44da-b1fd-b5876cb84039-kube-api-access-sspfb\") pod \"cert-manager-cainjector-559cdd8c87-nds6n\" (UID: \"6bd24f2e-fe77-44da-b1fd-b5876cb84039\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.344592 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.344572 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" Jul 05 13:24:40.473135 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.473112 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nds6n"] Jul 05 13:24:40.475782 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:24:40.475757 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bd24f2e_fe77_44da_b1fd_b5876cb84039.slice/crio-ab113a1bfa336f8bf75207386040185c15a897d1585467ce90eb6b90251df56e WatchSource:0}: Error finding container ab113a1bfa336f8bf75207386040185c15a897d1585467ce90eb6b90251df56e: Status 404 returned error can't find the container with id ab113a1bfa336f8bf75207386040185c15a897d1585467ce90eb6b90251df56e Jul 05 13:24:40.477714 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.477695 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:24:40.897707 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:40.897671 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" event={"ID":"6bd24f2e-fe77-44da-b1fd-b5876cb84039","Type":"ContainerStarted","Data":"ab113a1bfa336f8bf75207386040185c15a897d1585467ce90eb6b90251df56e"} Jul 05 13:24:43.911143 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:43.911110 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" event={"ID":"6bd24f2e-fe77-44da-b1fd-b5876cb84039","Type":"ContainerStarted","Data":"18139d539d3d1fc313ff38e843d06f678f7ee2a853b250be329b7815a7c66754"} Jul 05 13:24:43.934842 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:43.934794 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nds6n" podStartSLOduration=1.168816482 podStartE2EDuration="3.934773755s" totalImagesPullingTime="2.765957273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:43.932553669 +0000 UTC m=+376.013469075" watchObservedRunningTime="2026-07-05 13:24:43.934773755 +0000 UTC m=+376.015689141" Jul 05 13:24:44.028142 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:44.028106 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:44.097017 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:44.096986 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:46.574873 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:46.574836 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:46.794789 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:46.794750 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:46.948038 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:46.948004 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:53.194546 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:53.194508 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:53.289101 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:53.289068 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:24:55.049739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:24:55.049702 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:08.061046 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:08.061011 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:08.206772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:08.206734 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:08.878764 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:08.878718 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:09.513049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.513009 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:09.867599 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.867527 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq"] Jul 05 13:25:09.870778 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.870763 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.877948 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.877927 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 13:25:09.881161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.881140 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 13:25:09.887712 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.887687 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:09.888680 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.888664 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-24rg9\"" Jul 05 13:25:09.888845 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.888833 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 13:25:09.888947 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.888934 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 13:25:09.905176 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.905155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.905265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.905186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhvm\" (UniqueName: \"kubernetes.io/projected/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-kube-api-access-vrhvm\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.905265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.905207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.905265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.905237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.905364 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.905280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:09.935068 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:09.935042 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq"] Jul 05 13:25:10.006274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006244 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.006442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.006442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhvm\" (UniqueName: \"kubernetes.io/projected/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-kube-api-access-vrhvm\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.006442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.006442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006367 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.006754 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.006735 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.008631 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.008609 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.008910 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.008889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.008960 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.008889 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.034798 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.034768 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhvm\" (UniqueName: \"kubernetes.io/projected/6a20452e-cf1f-4f4a-b016-cd2b390aeb66-kube-api-access-vrhvm\") pod \"opendatahub-operator-controller-manager-54547f4bcb-jbvmq\" (UID: \"6a20452e-cf1f-4f4a-b016-cd2b390aeb66\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.180485 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.180452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:10.345206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.345171 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq"] Jul 05 13:25:10.346432 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:10.346408 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a20452e_cf1f_4f4a_b016_cd2b390aeb66.slice/crio-2f807258a3a2d3ae0567b576bd5f374432b4b332f54a3ae62f075ee90b880703 WatchSource:0}: Error finding container 2f807258a3a2d3ae0567b576bd5f374432b4b332f54a3ae62f075ee90b880703: Status 404 returned error can't find the container with id 2f807258a3a2d3ae0567b576bd5f374432b4b332f54a3ae62f075ee90b880703 Jul 05 13:25:10.411740 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.411710 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:10.532934 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.532848 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:10.651236 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.651204 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:10.922862 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:10.922762 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:11.022665 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:11.022628 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" event={"ID":"6a20452e-cf1f-4f4a-b016-cd2b390aeb66","Type":"ContainerStarted","Data":"2f807258a3a2d3ae0567b576bd5f374432b4b332f54a3ae62f075ee90b880703"} Jul 05 13:25:11.167133 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:11.167094 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:11.311327 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:11.311238 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:14.036804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:14.036774 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" event={"ID":"6a20452e-cf1f-4f4a-b016-cd2b390aeb66","Type":"ContainerStarted","Data":"95bb92a8fc98071cbe65b396a4298271f6d3e19af45facfb31658cd5216ab6f6"} Jul 05 13:25:15.042160 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:15.042120 2569 generic.go:356] "Generic (PLEG): container finished" podID="6a20452e-cf1f-4f4a-b016-cd2b390aeb66" containerID="95bb92a8fc98071cbe65b396a4298271f6d3e19af45facfb31658cd5216ab6f6" exitCode=0 Jul 05 13:25:15.042535 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:15.042201 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" event={"ID":"6a20452e-cf1f-4f4a-b016-cd2b390aeb66","Type":"ContainerDied","Data":"95bb92a8fc98071cbe65b396a4298271f6d3e19af45facfb31658cd5216ab6f6"} Jul 05 13:25:16.048655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:16.048617 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" event={"ID":"6a20452e-cf1f-4f4a-b016-cd2b390aeb66","Type":"ContainerStarted","Data":"5cc43b496164cc9c615b7c010fb711e4538c436d6e1c07761e468de5d7b8d5cd"} Jul 05 13:25:16.049023 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:16.048726 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:16.093629 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:16.093585 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" podStartSLOduration=2.966985063 podStartE2EDuration="7.093568782s" totalImagesPullingTime="3.035427684s" totalInitContainerRuntime="1.091156035s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:16.091012537 +0000 UTC m=+408.171927945" watchObservedRunningTime="2026-07-05 13:25:16.093568782 +0000 UTC m=+408.174484166" Jul 05 13:25:19.237165 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:19.237127 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:19.418360 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:19.418327 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:21.190776 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:21.190733 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:21.379687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:21.379651 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:24.395196 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:24.395155 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:24.568700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:24.568668 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:27.054920 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:27.054883 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-jbvmq" Jul 05 13:25:29.961053 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:29.961017 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:30.160808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.160775 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:30.503365 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.503327 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:30.643961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.643930 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-xzh77"] Jul 05 13:25:30.649072 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.649050 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.652102 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.652083 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 05 13:25:30.652210 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.652132 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 05 13:25:30.652264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.652239 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4tzjt\"" Jul 05 13:25:30.678427 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.678406 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-xzh77"] Jul 05 13:25:30.774363 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.774301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tmp\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.774363 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.774342 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tls-certs\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.774516 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.774395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-splf8\" (UniqueName: \"kubernetes.io/projected/0da033f1-acc6-48fe-b5a4-ac65b56e5629-kube-api-access-splf8\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.875706 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.875676 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-splf8\" (UniqueName: \"kubernetes.io/projected/0da033f1-acc6-48fe-b5a4-ac65b56e5629-kube-api-access-splf8\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.875818 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.875739 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tmp\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.875818 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.875782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tls-certs\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.877961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.877937 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tmp\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.878156 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.878139 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da033f1-acc6-48fe-b5a4-ac65b56e5629-tls-certs\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.912863 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.912835 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-splf8\" (UniqueName: \"kubernetes.io/projected/0da033f1-acc6-48fe-b5a4-ac65b56e5629-kube-api-access-splf8\") pod \"kube-auth-proxy-776bddfb77-xzh77\" (UID: \"0da033f1-acc6-48fe-b5a4-ac65b56e5629\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.942663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.942641 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-shgls"] Jul 05 13:25:30.945885 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.945870 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:30.948909 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.948889 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 05 13:25:30.949015 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.948894 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:30.949327 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.949313 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-khv6m\"" Jul 05 13:25:30.958530 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.958514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" Jul 05 13:25:30.978432 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:30.978411 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-shgls"] Jul 05 13:25:31.077162 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.077115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4tn\" (UniqueName: \"kubernetes.io/projected/9026ed1d-c5dc-490d-b9e2-d03304910068-kube-api-access-jh4tn\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.077320 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.077185 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9026ed1d-c5dc-490d-b9e2-d03304910068-cert\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.136906 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.136867 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:31.143924 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.143900 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-xzh77"] Jul 05 13:25:31.146122 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:31.146096 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da033f1_acc6_48fe_b5a4_ac65b56e5629.slice/crio-2700f13645d4ebe5d026a95a839f525f055fc6fcf7e20768d42c886872fdcc8c WatchSource:0}: Error finding container 2700f13645d4ebe5d026a95a839f525f055fc6fcf7e20768d42c886872fdcc8c: Status 404 returned error can't find the container with id 2700f13645d4ebe5d026a95a839f525f055fc6fcf7e20768d42c886872fdcc8c Jul 05 13:25:31.177706 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.177681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4tn\" (UniqueName: \"kubernetes.io/projected/9026ed1d-c5dc-490d-b9e2-d03304910068-kube-api-access-jh4tn\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.177816 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.177720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9026ed1d-c5dc-490d-b9e2-d03304910068-cert\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.180051 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.180031 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9026ed1d-c5dc-490d-b9e2-d03304910068-cert\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.197522 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.197499 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4tn\" (UniqueName: \"kubernetes.io/projected/9026ed1d-c5dc-490d-b9e2-d03304910068-kube-api-access-jh4tn\") pod \"odh-model-controller-7998c67dc4-shgls\" (UID: \"9026ed1d-c5dc-490d-b9e2-d03304910068\") " pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.256058 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.256026 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:31.263845 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.263817 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:31.366898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.366853 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:31.394588 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:31.394565 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-shgls"] Jul 05 13:25:31.396574 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:31.396550 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9026ed1d_c5dc_490d_b9e2_d03304910068.slice/crio-2241b7ff8dd68d047231ab935d14fe4574902a407239f54507bea986cd47ff5d WatchSource:0}: Error finding container 2241b7ff8dd68d047231ab935d14fe4574902a407239f54507bea986cd47ff5d: Status 404 returned error can't find the container with id 2241b7ff8dd68d047231ab935d14fe4574902a407239f54507bea986cd47ff5d Jul 05 13:25:32.119967 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.119932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" event={"ID":"0da033f1-acc6-48fe-b5a4-ac65b56e5629","Type":"ContainerStarted","Data":"2700f13645d4ebe5d026a95a839f525f055fc6fcf7e20768d42c886872fdcc8c"} Jul 05 13:25:32.121164 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.121134 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" event={"ID":"9026ed1d-c5dc-490d-b9e2-d03304910068","Type":"ContainerStarted","Data":"2241b7ff8dd68d047231ab935d14fe4574902a407239f54507bea986cd47ff5d"} Jul 05 13:25:32.326892 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.326850 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:32.390659 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.390576 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcmlq"] Jul 05 13:25:32.394294 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.394271 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.403868 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.403842 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 05 13:25:32.404185 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.404165 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-p7f5j\"" Jul 05 13:25:32.428881 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.428856 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcmlq"] Jul 05 13:25:32.490896 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.490832 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6be8445-83d4-464f-b389-688798b46c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.490896 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.490886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngss8\" (UniqueName: \"kubernetes.io/projected/b6be8445-83d4-464f-b389-688798b46c99-kube-api-access-ngss8\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.591775 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.591685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6be8445-83d4-464f-b389-688798b46c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.591997 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.591819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngss8\" (UniqueName: \"kubernetes.io/projected/b6be8445-83d4-464f-b389-688798b46c99-kube-api-access-ngss8\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.595321 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.595277 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6be8445-83d4-464f-b389-688798b46c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.606935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.606811 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:32.611874 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.611851 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngss8\" (UniqueName: \"kubernetes.io/projected/b6be8445-83d4-464f-b389-688798b46c99-kube-api-access-ngss8\") pod \"model-serving-api-54d89bd5fc-xcmlq\" (UID: \"b6be8445-83d4-464f-b389-688798b46c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.716349 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.716321 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:32.980907 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.980835 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:32.985568 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.985543 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:32.989973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.989945 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 13:25:32.990114 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.989992 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 13:25:32.990114 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.989994 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 13:25:32.990419 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.990400 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 13:25:32.990524 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.990461 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ndwlb\"" Jul 05 13:25:32.999017 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:32.998960 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:33.095394 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095344 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9bp\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.095753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.095719 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.108449 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.108418 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:33.196663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196632 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196676 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196705 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196740 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196835 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.196882 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9bp\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.197462 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.197441 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.199626 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.199593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.199730 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.199710 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.199815 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.199788 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.199979 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.199957 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.235515 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.235456 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9bp\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.237174 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.237154 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ldll4\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:33.263532 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.263506 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:33.297928 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:33.297905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:34.679178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:34.679153 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcmlq"] Jul 05 13:25:34.682374 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:34.682291 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6be8445_83d4_464f_b389_688798b46c99.slice/crio-19c28f83884e9f251be04497ece457acf6bcc551bd7a5e1adead2dd2236f2c7e WatchSource:0}: Error finding container 19c28f83884e9f251be04497ece457acf6bcc551bd7a5e1adead2dd2236f2c7e: Status 404 returned error can't find the container with id 19c28f83884e9f251be04497ece457acf6bcc551bd7a5e1adead2dd2236f2c7e Jul 05 13:25:34.683300 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:34.683277 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:34.684996 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:34.684977 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faa0576_da13_4897_8049_18b6ef592fdf.slice/crio-1a1ee4773f159d0609395de960dfa397f8d9d7e29ff65ac39026e60fd531a5be WatchSource:0}: Error finding container 1a1ee4773f159d0609395de960dfa397f8d9d7e29ff65ac39026e60fd531a5be: Status 404 returned error can't find the container with id 1a1ee4773f159d0609395de960dfa397f8d9d7e29ff65ac39026e60fd531a5be Jul 05 13:25:35.136968 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.136923 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" event={"ID":"9026ed1d-c5dc-490d-b9e2-d03304910068","Type":"ContainerStarted","Data":"1179bf2b7a7f66f64a7efbd25bb12622eb32963b11b90e03641171a0eb60b8f4"} Jul 05 13:25:35.137162 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.137055 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:35.138529 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.138499 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" event={"ID":"b6be8445-83d4-464f-b389-688798b46c99","Type":"ContainerStarted","Data":"19c28f83884e9f251be04497ece457acf6bcc551bd7a5e1adead2dd2236f2c7e"} Jul 05 13:25:35.140198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.140173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" event={"ID":"0da033f1-acc6-48fe-b5a4-ac65b56e5629","Type":"ContainerStarted","Data":"bad6520c9727da2fe713443706c7f3a3e0117785ba3c0ac401fc110ea00c2290"} Jul 05 13:25:35.141756 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.141732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" event={"ID":"4faa0576-da13-4897-8049-18b6ef592fdf","Type":"ContainerStarted","Data":"1a1ee4773f159d0609395de960dfa397f8d9d7e29ff65ac39026e60fd531a5be"} Jul 05 13:25:35.183120 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:35.183080 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" podStartSLOduration=2.09305049 podStartE2EDuration="5.183064557s" totalImagesPullingTime="3.090014067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:35.177344607 +0000 UTC m=+427.258259991" watchObservedRunningTime="2026-07-05 13:25:35.183064557 +0000 UTC m=+427.263979946" Jul 05 13:25:36.270611 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:36.270579 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:37.155741 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.155708 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" event={"ID":"b6be8445-83d4-464f-b389-688798b46c99","Type":"ContainerStarted","Data":"0bd2519b7418bae454149f50a4b70f0057c7cffe0af913e0e92dcb2862ede897"} Jul 05 13:25:37.155933 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.155793 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:37.239377 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.239327 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" podStartSLOduration=3.677984647 podStartE2EDuration="5.239311787s" totalImagesPullingTime="1.56132714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:37.239242455 +0000 UTC m=+429.320157839" watchObservedRunningTime="2026-07-05 13:25:37.239311787 +0000 UTC m=+429.320227172" Jul 05 13:25:37.240274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.240236 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-776bddfb77-xzh77" podStartSLOduration=3.913314334 podStartE2EDuration="7.240222758s" totalImagesPullingTime="3.326908424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:35.276562133 +0000 UTC m=+427.357477545" watchObservedRunningTime="2026-07-05 13:25:37.240222758 +0000 UTC m=+429.321138177" Jul 05 13:25:37.326698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.326656 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 13:25:37.326967 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:37.326735 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 13:25:38.162200 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:38.162167 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" event={"ID":"4faa0576-da13-4897-8049-18b6ef592fdf","Type":"ContainerStarted","Data":"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78"} Jul 05 13:25:38.225709 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:38.225644 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" podStartSLOduration=3.5862185330000003 podStartE2EDuration="6.225629396s" totalImagesPullingTime="2.639410863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:38.224178358 +0000 UTC m=+430.305093745" watchObservedRunningTime="2026-07-05 13:25:38.225629396 +0000 UTC m=+430.306544780" Jul 05 13:25:38.870942 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:38.870898 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:39.166291 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:39.166263 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:39.167886 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:39.167858 2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ldll4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:25:39.168004 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:39.167916 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:25:39.228867 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:39.228833 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:40.170872 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:40.170841 2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ldll4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:25:40.171227 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:40.170903 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:25:41.769449 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:41.769413 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:42.230833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:42.230797 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:42.704693 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:42.704663 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:43.171095 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:43.171070 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:46.151540 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:46.151502 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-shgls" Jul 05 13:25:48.166608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:48.166580 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xcmlq" Jul 05 13:25:49.285567 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:49.285532 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:49.606056 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:49.605966 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:50.464529 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.464457 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:50.735581 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.735509 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-chk4r"] Jul 05 13:25:50.741681 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.741662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.752792 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.752772 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4m2fd\"" Jul 05 13:25:50.759758 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.759742 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 05 13:25:50.779968 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.779942 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-chk4r"] Jul 05 13:25:50.811821 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.811788 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:50.823181 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.823158 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb"] Jul 05 13:25:50.827133 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.827116 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:50.831525 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.831505 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-87r2g\"" Jul 05 13:25:50.831613 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.831570 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 05 13:25:50.846428 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.846403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjlx\" (UniqueName: \"kubernetes.io/projected/dd2a5391-6053-4048-b48f-e74250980672-kube-api-access-wvjlx\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.846539 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.846500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2a5391-6053-4048-b48f-e74250980672-cert\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.909841 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.909809 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb"] Jul 05 13:25:50.946898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.946871 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjlx\" (UniqueName: \"kubernetes.io/projected/dd2a5391-6053-4048-b48f-e74250980672-kube-api-access-wvjlx\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.946898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.946898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx28f\" (UniqueName: \"kubernetes.io/projected/96c2f716-a13a-4de4-98fc-f7fbfde0b277-kube-api-access-cx28f\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:50.947059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.946953 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c2f716-a13a-4de4-98fc-f7fbfde0b277-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:50.947059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.946977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2a5391-6053-4048-b48f-e74250980672-cert\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.949438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.949418 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd2a5391-6053-4048-b48f-e74250980672-cert\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:50.983042 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:50.983018 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjlx\" (UniqueName: \"kubernetes.io/projected/dd2a5391-6053-4048-b48f-e74250980672-kube-api-access-wvjlx\") pod \"kserve-controller-manager-d6f4b65b8-chk4r\" (UID: \"dd2a5391-6053-4048-b48f-e74250980672\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:51.047703 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.047641 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx28f\" (UniqueName: \"kubernetes.io/projected/96c2f716-a13a-4de4-98fc-f7fbfde0b277-kube-api-access-cx28f\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:51.047804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.047792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c2f716-a13a-4de4-98fc-f7fbfde0b277-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:51.049943 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.049926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c2f716-a13a-4de4-98fc-f7fbfde0b277-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:51.051840 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.051823 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:51.088434 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.088412 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx28f\" (UniqueName: \"kubernetes.io/projected/96c2f716-a13a-4de4-98fc-f7fbfde0b277-kube-api-access-cx28f\") pod \"llmisvc-controller-manager-777c6bd7d5-945pb\" (UID: \"96c2f716-a13a-4de4-98fc-f7fbfde0b277\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:51.136757 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.136730 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:51.169571 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.169533 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:51.300072 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.299997 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-chk4r"] Jul 05 13:25:51.320799 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:51.320774 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2a5391_6053_4048_b48f_e74250980672.slice/crio-4f83b48113791bd3121b6e4aa8e55d3f19dfaa127ba3ac2d54ed7e9d19892474 WatchSource:0}: Error finding container 4f83b48113791bd3121b6e4aa8e55d3f19dfaa127ba3ac2d54ed7e9d19892474: Status 404 returned error can't find the container with id 4f83b48113791bd3121b6e4aa8e55d3f19dfaa127ba3ac2d54ed7e9d19892474 Jul 05 13:25:51.406212 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:51.406181 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb"] Jul 05 13:25:51.408955 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:25:51.408931 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96c2f716_a13a_4de4_98fc_f7fbfde0b277.slice/crio-e1a37fafb2735156b257ed82359b4d1daf6bbde63cb8c9880cacd670c0220470 WatchSource:0}: Error finding container e1a37fafb2735156b257ed82359b4d1daf6bbde63cb8c9880cacd670c0220470: Status 404 returned error can't find the container with id e1a37fafb2735156b257ed82359b4d1daf6bbde63cb8c9880cacd670c0220470 Jul 05 13:25:52.229094 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:52.229055 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" event={"ID":"96c2f716-a13a-4de4-98fc-f7fbfde0b277","Type":"ContainerStarted","Data":"e1a37fafb2735156b257ed82359b4d1daf6bbde63cb8c9880cacd670c0220470"} Jul 05 13:25:52.230956 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:52.230919 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" event={"ID":"dd2a5391-6053-4048-b48f-e74250980672","Type":"ContainerStarted","Data":"4f83b48113791bd3121b6e4aa8e55d3f19dfaa127ba3ac2d54ed7e9d19892474"} Jul 05 13:25:52.683575 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:52.683431 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:53.358989 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:53.358950 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:53.693934 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:53.693895 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:25:54.246419 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.246316 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" event={"ID":"96c2f716-a13a-4de4-98fc-f7fbfde0b277","Type":"ContainerStarted","Data":"7ed13f9e82ed508a165d4fd67e0147b2bfa9ed0071cb57d6a7f23cefec1ec76e"} Jul 05 13:25:54.246590 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.246425 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:25:54.247931 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.247906 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" event={"ID":"dd2a5391-6053-4048-b48f-e74250980672","Type":"ContainerStarted","Data":"648c9d1ed165311394f756aa1189dedf959729506d1b067e97d17f7567e02c18"} Jul 05 13:25:54.248067 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.248029 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:25:54.347985 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.347933 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" podStartSLOduration=1.848016243 podStartE2EDuration="4.347915868s" totalImagesPullingTime="2.499899625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:54.346844242 +0000 UTC m=+446.427759651" watchObservedRunningTime="2026-07-05 13:25:54.347915868 +0000 UTC m=+446.428831253" Jul 05 13:25:54.407169 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:54.407119 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" podStartSLOduration=1.8291999859999999 podStartE2EDuration="4.407103656s" totalImagesPullingTime="2.57790367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:54.40633154 +0000 UTC m=+446.487246941" watchObservedRunningTime="2026-07-05 13:25:54.407103656 +0000 UTC m=+446.488019041" Jul 05 13:25:56.301451 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.301413 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:56.301811 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.301629 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" containerID="cri-o://07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78" gracePeriod=30 Jul 05 13:25:56.566868 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.566844 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:56.695766 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695740 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l9bp\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.695945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695784 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.695945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695815 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.695945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695883 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.695945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695916 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.696137 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695946 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.696137 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.695982 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token\") pod \"4faa0576-da13-4897-8049-18b6ef592fdf\" (UID: \"4faa0576-da13-4897-8049-18b6ef592fdf\") " Jul 05 13:25:56.696297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.696265 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:25:56.698209 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698180 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs" (OuterVolumeSpecName: "local-certs") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:25:56.698209 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698185 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:25:56.698426 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698401 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp" (OuterVolumeSpecName: "kube-api-access-5l9bp") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "kube-api-access-5l9bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:25:56.698489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698450 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts" (OuterVolumeSpecName: "cacerts") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:25:56.698534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698493 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token" (OuterVolumeSpecName: "istio-token") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:25:56.698581 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.698558 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4faa0576-da13-4897-8049-18b6ef592fdf" (UID: "4faa0576-da13-4897-8049-18b6ef592fdf"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:25:56.797268 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797235 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l9bp\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-kube-api-access-5l9bp\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797268 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797260 2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-dns-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797268 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797270 2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4faa0576-da13-4897-8049-18b6ef592fdf-istio-csr-ca-configmap\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797279 2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-cacerts\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797289 2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4faa0576-da13-4897-8049-18b6ef592fdf-local-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797297 2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4faa0576-da13-4897-8049-18b6ef592fdf-istio-kubeconfig\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:56.797501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:56.797304 2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4faa0576-da13-4897-8049-18b6ef592fdf-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:25:57.262955 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.262916 2569 generic.go:356] "Generic (PLEG): container finished" podID="4faa0576-da13-4897-8049-18b6ef592fdf" containerID="07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78" exitCode=0 Jul 05 13:25:57.262955 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.262958 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" Jul 05 13:25:57.263198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.262999 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" event={"ID":"4faa0576-da13-4897-8049-18b6ef592fdf","Type":"ContainerDied","Data":"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78"} Jul 05 13:25:57.263198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.263047 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ldll4" event={"ID":"4faa0576-da13-4897-8049-18b6ef592fdf","Type":"ContainerDied","Data":"1a1ee4773f159d0609395de960dfa397f8d9d7e29ff65ac39026e60fd531a5be"} Jul 05 13:25:57.263198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.263072 2569 scope.go:117] "RemoveContainer" containerID="07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78" Jul 05 13:25:57.272361 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.272345 2569 scope.go:117] "RemoveContainer" containerID="07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78" Jul 05 13:25:57.272624 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:25:57.272606 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78\": container with ID starting with 07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78 not found: ID does not exist" containerID="07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78" Jul 05 13:25:57.272671 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.272632 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78"} err="failed to get container status \"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78\": rpc error: code = NotFound desc = could not find container \"07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78\": container with ID starting with 07e499e120e9b8b93391ed4ac1291fb25783c7878c4e233ea25aff058f329c78 not found: ID does not exist" Jul 05 13:25:57.299872 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.299847 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:57.316029 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:57.316007 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ldll4"] Jul 05 13:25:58.414739 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:25:58.414696 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" path="/var/lib/kubelet/pods/4faa0576-da13-4897-8049-18b6ef592fdf/volumes" Jul 05 13:26:25.254756 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:25.254728 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-945pb" Jul 05 13:26:25.257920 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:25.257903 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-chk4r" Jul 05 13:26:31.583868 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.583826 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:31.732909 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.732865 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:31.750626 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.750596 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:31.750977 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.750963 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" Jul 05 13:26:31.751019 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.750979 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" Jul 05 13:26:31.751053 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.751034 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4faa0576-da13-4897-8049-18b6ef592fdf" containerName="discovery" Jul 05 13:26:31.755795 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.755776 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:31.761116 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.761091 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 13:26:31.762167 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.762147 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gxd6d\"" Jul 05 13:26:31.762277 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.762179 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 13:26:31.770070 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.770045 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:31.873548 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.873477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6mc\" (UniqueName: \"kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc\") pod \"kuadrant-operator-catalog-t22gm\" (UID: \"62800c39-3a62-45fd-8c61-f92a83b3d4d7\") " pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:31.927694 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.927660 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:31.973965 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.973942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6mc\" (UniqueName: \"kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc\") pod \"kuadrant-operator-catalog-t22gm\" (UID: \"62800c39-3a62-45fd-8c61-f92a83b3d4d7\") " pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:31.992233 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:31.992208 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6mc\" (UniqueName: \"kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc\") pod \"kuadrant-operator-catalog-t22gm\" (UID: \"62800c39-3a62-45fd-8c61-f92a83b3d4d7\") " pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:32.047877 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.047854 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:32.048103 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.048090 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:32.221011 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.220979 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:32.224035 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:26:32.224007 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62800c39_3a62_45fd_8c61_f92a83b3d4d7.slice/crio-81f7a69d39b67b2449b1897e0e8e5e54f62b5c893fa70ea1ce7bad8d2204666e WatchSource:0}: Error finding container 81f7a69d39b67b2449b1897e0e8e5e54f62b5c893fa70ea1ce7bad8d2204666e: Status 404 returned error can't find the container with id 81f7a69d39b67b2449b1897e0e8e5e54f62b5c893fa70ea1ce7bad8d2204666e Jul 05 13:26:32.258994 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.258970 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4m2z"] Jul 05 13:26:32.261782 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.261767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:32.285531 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.285502 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4m2z"] Jul 05 13:26:32.377464 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.377400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzwl\" (UniqueName: \"kubernetes.io/projected/04bf4f81-5c97-476e-b124-b686e14fe346-kube-api-access-8pzwl\") pod \"kuadrant-operator-catalog-q4m2z\" (UID: \"04bf4f81-5c97-476e-b124-b686e14fe346\") " pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:32.418775 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.418749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" event={"ID":"62800c39-3a62-45fd-8c61-f92a83b3d4d7","Type":"ContainerStarted","Data":"81f7a69d39b67b2449b1897e0e8e5e54f62b5c893fa70ea1ce7bad8d2204666e"} Jul 05 13:26:32.477991 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.477966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzwl\" (UniqueName: \"kubernetes.io/projected/04bf4f81-5c97-476e-b124-b686e14fe346-kube-api-access-8pzwl\") pod \"kuadrant-operator-catalog-q4m2z\" (UID: \"04bf4f81-5c97-476e-b124-b686e14fe346\") " pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:32.490129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.490097 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzwl\" (UniqueName: \"kubernetes.io/projected/04bf4f81-5c97-476e-b124-b686e14fe346-kube-api-access-8pzwl\") pod \"kuadrant-operator-catalog-q4m2z\" (UID: \"04bf4f81-5c97-476e-b124-b686e14fe346\") " pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:32.499352 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.499323 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:32.571236 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.571215 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:32.730357 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.730330 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q4m2z"] Jul 05 13:26:32.750608 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:26:32.750574 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bf4f81_5c97_476e_b124_b686e14fe346.slice/crio-47eec19b0dc9badc7d5b431bfcd0196d5fd939b41e31080257a385a60aa3bbfb WatchSource:0}: Error finding container 47eec19b0dc9badc7d5b431bfcd0196d5fd939b41e31080257a385a60aa3bbfb: Status 404 returned error can't find the container with id 47eec19b0dc9badc7d5b431bfcd0196d5fd939b41e31080257a385a60aa3bbfb Jul 05 13:26:32.760899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:32.760874 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:33.426742 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:33.426701 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" event={"ID":"04bf4f81-5c97-476e-b124-b686e14fe346","Type":"ContainerStarted","Data":"47eec19b0dc9badc7d5b431bfcd0196d5fd939b41e31080257a385a60aa3bbfb"} Jul 05 13:26:34.432137 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.432101 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" event={"ID":"04bf4f81-5c97-476e-b124-b686e14fe346","Type":"ContainerStarted","Data":"4fe4bd04221a8c89b494d10b440bc4a168f762b6785beca89a0df874dff5cb18"} Jul 05 13:26:34.433607 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.433584 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" event={"ID":"62800c39-3a62-45fd-8c61-f92a83b3d4d7","Type":"ContainerStarted","Data":"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23"} Jul 05 13:26:34.433720 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.433666 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" podUID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" containerName="registry-server" containerID="cri-o://0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23" gracePeriod=2 Jul 05 13:26:34.487448 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.487378 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" podStartSLOduration=1.217914996 podStartE2EDuration="2.487361794s" totalImagesPullingTime="1.269446798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:34.486586499 +0000 UTC m=+486.567501885" watchObservedRunningTime="2026-07-05 13:26:34.487361794 +0000 UTC m=+486.568277207" Jul 05 13:26:34.529274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.529220 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" podStartSLOduration=1.733805727 podStartE2EDuration="3.529204546s" totalImagesPullingTime="1.795398819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:34.527934378 +0000 UTC m=+486.608849791" watchObservedRunningTime="2026-07-05 13:26:34.529204546 +0000 UTC m=+486.610119930" Jul 05 13:26:34.681653 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.681627 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:34.800628 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.800539 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z6mc\" (UniqueName: \"kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc\") pod \"62800c39-3a62-45fd-8c61-f92a83b3d4d7\" (UID: \"62800c39-3a62-45fd-8c61-f92a83b3d4d7\") " Jul 05 13:26:34.802614 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.802591 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc" (OuterVolumeSpecName: "kube-api-access-6z6mc") pod "62800c39-3a62-45fd-8c61-f92a83b3d4d7" (UID: "62800c39-3a62-45fd-8c61-f92a83b3d4d7"). InnerVolumeSpecName "kube-api-access-6z6mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:26:34.901905 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:34.901876 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z6mc\" (UniqueName: \"kubernetes.io/projected/62800c39-3a62-45fd-8c61-f92a83b3d4d7-kube-api-access-6z6mc\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:26:35.439468 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.439426 2569 generic.go:356] "Generic (PLEG): container finished" podID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" containerID="0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23" exitCode=0 Jul 05 13:26:35.439940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.439470 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" Jul 05 13:26:35.439940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.439515 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" event={"ID":"62800c39-3a62-45fd-8c61-f92a83b3d4d7","Type":"ContainerDied","Data":"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23"} Jul 05 13:26:35.439940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.439561 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t22gm" event={"ID":"62800c39-3a62-45fd-8c61-f92a83b3d4d7","Type":"ContainerDied","Data":"81f7a69d39b67b2449b1897e0e8e5e54f62b5c893fa70ea1ce7bad8d2204666e"} Jul 05 13:26:35.439940 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.439590 2569 scope.go:117] "RemoveContainer" containerID="0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23" Jul 05 13:26:35.448618 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.448598 2569 scope.go:117] "RemoveContainer" containerID="0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23" Jul 05 13:26:35.448861 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:26:35.448845 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23\": container with ID starting with 0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23 not found: ID does not exist" containerID="0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23" Jul 05 13:26:35.448900 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.448867 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23"} err="failed to get container status \"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23\": rpc error: code = NotFound desc = could not find container \"0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23\": container with ID starting with 0e9abe214114c1f43064eea4e4d646053156e6d11cdc074996ad03d0d4d4df23 not found: ID does not exist" Jul 05 13:26:35.474241 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.474221 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:35.481555 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:35.481537 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t22gm"] Jul 05 13:26:36.414960 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:36.414916 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" path="/var/lib/kubelet/pods/62800c39-3a62-45fd-8c61-f92a83b3d4d7/volumes" Jul 05 13:26:42.571480 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:42.571448 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:42.572044 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:42.571504 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:42.593870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:42.593844 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:43.497668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:43.497642 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-q4m2z" Jul 05 13:26:47.285022 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:47.284985 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:47.476573 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:47.476530 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:56.227297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:56.227258 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:56.994888 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:56.994848 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:57.538557 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:57.538526 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:58.500604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:58.500569 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:58.642275 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:58.642242 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:26:58.751376 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:26:58.751289 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:00.343804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:00.343769 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:00.596891 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:00.596809 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:01.019577 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.019543 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6"] Jul 05 13:27:01.019910 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.019897 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" containerName="registry-server" Jul 05 13:27:01.019957 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.019912 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" containerName="registry-server" Jul 05 13:27:01.020001 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.019984 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="62800c39-3a62-45fd-8c61-f92a83b3d4d7" containerName="registry-server" Jul 05 13:27:01.023198 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.023180 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:01.027949 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.027927 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-64xvj\"" Jul 05 13:27:01.037693 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.037666 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6"] Jul 05 13:27:01.121608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.121567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvq8d\" (UniqueName: \"kubernetes.io/projected/ec62d6f0-541e-47a5-b8cf-6e827a7124b4-kube-api-access-dvq8d\") pod \"authorino-operator-75cc8d5cb7-xqlj6\" (UID: \"ec62d6f0-541e-47a5-b8cf-6e827a7124b4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:01.222666 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.222626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvq8d\" (UniqueName: \"kubernetes.io/projected/ec62d6f0-541e-47a5-b8cf-6e827a7124b4-kube-api-access-dvq8d\") pod \"authorino-operator-75cc8d5cb7-xqlj6\" (UID: \"ec62d6f0-541e-47a5-b8cf-6e827a7124b4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:01.240493 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.240455 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvq8d\" (UniqueName: \"kubernetes.io/projected/ec62d6f0-541e-47a5-b8cf-6e827a7124b4-kube-api-access-dvq8d\") pod \"authorino-operator-75cc8d5cb7-xqlj6\" (UID: \"ec62d6f0-541e-47a5-b8cf-6e827a7124b4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:01.333205 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.333111 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:01.476931 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.476905 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6"] Jul 05 13:27:01.478846 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:01.478819 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec62d6f0_541e_47a5_b8cf_6e827a7124b4.slice/crio-6cfe86417119b4ad8d2266a6ea577e246b44c1b7ebeb8901274238eff809501e WatchSource:0}: Error finding container 6cfe86417119b4ad8d2266a6ea577e246b44c1b7ebeb8901274238eff809501e: Status 404 returned error can't find the container with id 6cfe86417119b4ad8d2266a6ea577e246b44c1b7ebeb8901274238eff809501e Jul 05 13:27:01.561029 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.560993 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" event={"ID":"ec62d6f0-541e-47a5-b8cf-6e827a7124b4","Type":"ContainerStarted","Data":"6cfe86417119b4ad8d2266a6ea577e246b44c1b7ebeb8901274238eff809501e"} Jul 05 13:27:01.990093 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:01.990044 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:02.761563 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:02.761524 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:04.577291 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:04.577256 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" event={"ID":"ec62d6f0-541e-47a5-b8cf-6e827a7124b4","Type":"ContainerStarted","Data":"ace54e9c5982d239bc3ddfde5b9469198933d02fcc3f58e02e39c201ce9cbfb8"} Jul 05 13:27:04.577700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:04.577400 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:04.609970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:04.609924 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" podStartSLOduration=2.465900126 podStartE2EDuration="4.609908967s" totalImagesPullingTime="2.144008841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:04.605171172 +0000 UTC m=+516.686086570" watchObservedRunningTime="2026-07-05 13:27:04.609908967 +0000 UTC m=+516.690824352" Jul 05 13:27:05.310362 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.310330 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc"] Jul 05 13:27:05.314042 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.314021 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.316863 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.316841 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n9ml6\"" Jul 05 13:27:05.345073 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.345035 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc"] Jul 05 13:27:05.462929 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.462899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.463053 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.462947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbt6m\" (UniqueName: \"kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.563980 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.563906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.563980 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.563964 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbt6m\" (UniqueName: \"kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.564292 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.564273 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.590329 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.590302 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbt6m\" (UniqueName: \"kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.623970 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.623943 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:05.779305 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.779270 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc"] Jul 05 13:27:05.783822 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:05.783796 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9125f7_a2e5_4832_a541_a0759aa0e4e0.slice/crio-5db1f7e1693c6d1704cf42c33a4dc8a0fd1f03daad4ccfd7dfd49e75dd56f37c WatchSource:0}: Error finding container 5db1f7e1693c6d1704cf42c33a4dc8a0fd1f03daad4ccfd7dfd49e75dd56f37c: Status 404 returned error can't find the container with id 5db1f7e1693c6d1704cf42c33a4dc8a0fd1f03daad4ccfd7dfd49e75dd56f37c Jul 05 13:27:05.870038 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:05.869964 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:06.029189 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:06.029148 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:06.588623 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:06.588590 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" event={"ID":"7f9125f7-a2e5-4832-a541-a0759aa0e4e0","Type":"ContainerStarted","Data":"5db1f7e1693c6d1704cf42c33a4dc8a0fd1f03daad4ccfd7dfd49e75dd56f37c"} Jul 05 13:27:07.638274 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.638244 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx"] Jul 05 13:27:07.646410 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.646374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:07.649416 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.649339 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 05 13:27:07.649602 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.649588 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hbw4k\"" Jul 05 13:27:07.659810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.659784 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx"] Jul 05 13:27:07.681220 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.681183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwj4\" (UniqueName: \"kubernetes.io/projected/e97e4fa2-9cab-4a21-90ea-53fb7e271723-kube-api-access-7jwj4\") pod \"dns-operator-controller-manager-864dd78c4c-t2snx\" (UID: \"e97e4fa2-9cab-4a21-90ea-53fb7e271723\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:07.781992 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.781952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwj4\" (UniqueName: \"kubernetes.io/projected/e97e4fa2-9cab-4a21-90ea-53fb7e271723-kube-api-access-7jwj4\") pod \"dns-operator-controller-manager-864dd78c4c-t2snx\" (UID: \"e97e4fa2-9cab-4a21-90ea-53fb7e271723\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:07.793183 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.793159 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwj4\" (UniqueName: \"kubernetes.io/projected/e97e4fa2-9cab-4a21-90ea-53fb7e271723-kube-api-access-7jwj4\") pod \"dns-operator-controller-manager-864dd78c4c-t2snx\" (UID: \"e97e4fa2-9cab-4a21-90ea-53fb7e271723\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:07.961957 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:07.961922 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:08.124070 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:08.124038 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx"] Jul 05 13:27:08.127313 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:08.127283 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97e4fa2_9cab_4a21_90ea_53fb7e271723.slice/crio-95fb33d833b803366fed8e599e013777d27df1963fc3176d4cc834e8cd1cbc27 WatchSource:0}: Error finding container 95fb33d833b803366fed8e599e013777d27df1963fc3176d4cc834e8cd1cbc27: Status 404 returned error can't find the container with id 95fb33d833b803366fed8e599e013777d27df1963fc3176d4cc834e8cd1cbc27 Jul 05 13:27:08.163767 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:08.163728 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:08.599214 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:08.599184 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" event={"ID":"e97e4fa2-9cab-4a21-90ea-53fb7e271723","Type":"ContainerStarted","Data":"95fb33d833b803366fed8e599e013777d27df1963fc3176d4cc834e8cd1cbc27"} Jul 05 13:27:09.595139 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.595078 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:09.657685 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.657654 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf"] Jul 05 13:27:09.661240 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.661215 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:09.664164 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.664141 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-smj4j\"" Jul 05 13:27:09.684025 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.684002 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf"] Jul 05 13:27:09.699616 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.699594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6sqf\" (UniqueName: \"kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf\") pod \"limitador-operator-controller-manager-859d7b78bd-54nqf\" (UID: \"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:09.800257 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.800215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6sqf\" (UniqueName: \"kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf\") pod \"limitador-operator-controller-manager-859d7b78bd-54nqf\" (UID: \"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:09.814823 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.814791 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6sqf\" (UniqueName: \"kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf\") pod \"limitador-operator-controller-manager-859d7b78bd-54nqf\" (UID: \"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:09.973418 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:09.973376 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:10.257119 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:10.257085 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf"] Jul 05 13:27:10.293838 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:10.293809 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d30647a_11d6_4dad_a4b5_2ad5ec3af45e.slice/crio-23b88eb3a555e8be67910d3491dafc07f8bb4fd640484990cb8f736ecf116777 WatchSource:0}: Error finding container 23b88eb3a555e8be67910d3491dafc07f8bb4fd640484990cb8f736ecf116777: Status 404 returned error can't find the container with id 23b88eb3a555e8be67910d3491dafc07f8bb4fd640484990cb8f736ecf116777 Jul 05 13:27:10.612477 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:10.612375 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" event={"ID":"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e","Type":"ContainerStarted","Data":"23b88eb3a555e8be67910d3491dafc07f8bb4fd640484990cb8f736ecf116777"} Jul 05 13:27:11.178912 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.178847 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:11.284808 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.284771 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:11.552938 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.552891 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:11.620889 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.620846 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" event={"ID":"e97e4fa2-9cab-4a21-90ea-53fb7e271723","Type":"ContainerStarted","Data":"dc5e901890456d7954df16e2ec3e60766b86db6c4736fb1ed8548b5b497f0a5e"} Jul 05 13:27:11.621342 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.621054 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:11.622752 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.622729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" event={"ID":"7f9125f7-a2e5-4832-a541-a0759aa0e4e0","Type":"ContainerStarted","Data":"f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53"} Jul 05 13:27:11.622886 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.622790 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:11.647939 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.647887 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" podStartSLOduration=1.755179371 podStartE2EDuration="4.647868788s" totalImagesPullingTime="2.892689417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:11.644690056 +0000 UTC m=+523.725605440" watchObservedRunningTime="2026-07-05 13:27:11.647868788 +0000 UTC m=+523.728784152" Jul 05 13:27:11.673810 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.673778 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:11.675622 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:11.675575 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" podStartSLOduration=2.294808586 podStartE2EDuration="6.675558332s" totalImagesPullingTime="4.380749746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:11.674185647 +0000 UTC m=+523.755101051" watchObservedRunningTime="2026-07-05 13:27:11.675558332 +0000 UTC m=+523.756473717" Jul 05 13:27:12.628590 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:12.628545 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" event={"ID":"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e","Type":"ContainerStarted","Data":"f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352"} Jul 05 13:27:12.629056 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:12.628874 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:12.648602 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:12.648546 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" podStartSLOduration=2.1721655970000002 podStartE2EDuration="3.648527631s" totalImagesPullingTime="1.476362034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:12.645971982 +0000 UTC m=+524.726887397" watchObservedRunningTime="2026-07-05 13:27:12.648527631 +0000 UTC m=+524.729443017" Jul 05 13:27:13.665642 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.665610 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5"] Jul 05 13:27:13.668632 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.668616 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.674548 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.674517 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 05 13:27:13.674680 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.674571 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4crjk\"" Jul 05 13:27:13.674864 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.674845 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 05 13:27:13.690161 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.690137 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5"] Jul 05 13:27:13.705967 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.705945 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:13.737472 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.737448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14056ad7-d1bf-4e25-b7db-7dc35fc97376-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.737564 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.737478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14056ad7-d1bf-4e25-b7db-7dc35fc97376-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.737612 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.737568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8h5\" (UniqueName: \"kubernetes.io/projected/14056ad7-d1bf-4e25-b7db-7dc35fc97376-kube-api-access-6t8h5\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.832102 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.832069 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:13.838620 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.838594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8h5\" (UniqueName: \"kubernetes.io/projected/14056ad7-d1bf-4e25-b7db-7dc35fc97376-kube-api-access-6t8h5\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.838749 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.838651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14056ad7-d1bf-4e25-b7db-7dc35fc97376-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.838749 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.838682 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14056ad7-d1bf-4e25-b7db-7dc35fc97376-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.839285 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.839263 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14056ad7-d1bf-4e25-b7db-7dc35fc97376-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.841091 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.841072 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14056ad7-d1bf-4e25-b7db-7dc35fc97376-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.853680 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.853651 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8h5\" (UniqueName: \"kubernetes.io/projected/14056ad7-d1bf-4e25-b7db-7dc35fc97376-kube-api-access-6t8h5\") pod \"kuadrant-console-plugin-66b5774985-ftgg5\" (UID: \"14056ad7-d1bf-4e25-b7db-7dc35fc97376\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:13.978016 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:13.977948 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" Jul 05 13:27:14.122148 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:14.122123 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5"] Jul 05 13:27:14.124141 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:14.124106 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14056ad7_d1bf_4e25_b7db_7dc35fc97376.slice/crio-58f7d1c4f79d66b4ae8940b168cf2d55556f07035f0acfc1038d2b53e62ecb32 WatchSource:0}: Error finding container 58f7d1c4f79d66b4ae8940b168cf2d55556f07035f0acfc1038d2b53e62ecb32: Status 404 returned error can't find the container with id 58f7d1c4f79d66b4ae8940b168cf2d55556f07035f0acfc1038d2b53e62ecb32 Jul 05 13:27:14.639638 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:14.639605 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" event={"ID":"14056ad7-d1bf-4e25-b7db-7dc35fc97376","Type":"ContainerStarted","Data":"58f7d1c4f79d66b4ae8940b168cf2d55556f07035f0acfc1038d2b53e62ecb32"} Jul 05 13:27:14.964932 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:14.964879 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:15.034167 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:15.034133 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:15.585265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:15.585218 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xqlj6" Jul 05 13:27:22.559564 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:22.559364 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:22.630501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:22.630430 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2snx" Jul 05 13:27:22.630663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:22.630510 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:22.661520 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:22.661428 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:23.636666 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:23.636633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:24.561697 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.561662 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc"] Jul 05 13:27:24.561920 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.561860 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" containerName="manager" containerID="cri-o://f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53" gracePeriod=2 Jul 05 13:27:24.563597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.563574 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc"] Jul 05 13:27:24.566823 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.566778 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:24.593462 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.593419 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf"] Jul 05 13:27:24.593658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.593632 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" containerName="manager" containerID="cri-o://f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352" gracePeriod=2 Jul 05 13:27:24.604609 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.604586 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf"] Jul 05 13:27:24.605397 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.605345 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:24.614509 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.614432 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:24.614892 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.614874 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" containerName="manager" Jul 05 13:27:24.614972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.614894 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" containerName="manager" Jul 05 13:27:24.614972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.614920 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" containerName="manager" Jul 05 13:27:24.614972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.614930 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" containerName="manager" Jul 05 13:27:24.615112 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.615050 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" containerName="manager" Jul 05 13:27:24.615112 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.615062 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" containerName="manager" Jul 05 13:27:24.632064 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.632035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.633619 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.633565 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc"] Jul 05 13:27:24.641250 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.641230 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:24.641613 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.641328 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:24.649201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.649177 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc"] Jul 05 13:27:24.664541 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.664509 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:24.669176 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.669149 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:24.672925 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.672898 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:24.675133 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.675101 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:24.738686 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.738648 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9k5k\" (UniqueName: \"kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.738819 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.738726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7s9\" (UniqueName: \"kubernetes.io/projected/13960c6c-3284-4bf6-a168-38202524d5de-kube-api-access-gk7s9\") pod \"limitador-operator-controller-manager-859d7b78bd-ssrwc\" (UID: \"13960c6c-3284-4bf6-a168-38202524d5de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:24.738819 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.738789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.840347 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.840256 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9k5k\" (UniqueName: \"kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.840347 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.840300 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7s9\" (UniqueName: \"kubernetes.io/projected/13960c6c-3284-4bf6-a168-38202524d5de-kube-api-access-gk7s9\") pod \"limitador-operator-controller-manager-859d7b78bd-ssrwc\" (UID: \"13960c6c-3284-4bf6-a168-38202524d5de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:24.840607 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.840448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.840862 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.840840 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.848516 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.848490 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:27:24.856501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.856472 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7s9\" (UniqueName: \"kubernetes.io/projected/13960c6c-3284-4bf6-a168-38202524d5de-kube-api-access-gk7s9\") pod \"limitador-operator-controller-manager-859d7b78bd-ssrwc\" (UID: \"13960c6c-3284-4bf6-a168-38202524d5de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:24.856952 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.856930 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9k5k\" (UniqueName: \"kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8ng9q\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:24.861213 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.861195 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:24.879770 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.879737 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:27:24.931345 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.931307 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:24.935751 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:24.935711 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:24.941492 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.941138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ddm\" (UniqueName: \"kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:24.941492 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:24.941247 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:25.036366 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.036333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:25.041729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.041699 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:25.041868 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.041793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ddm\" (UniqueName: \"kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:25.042099 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.042079 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:25.043550 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.043533 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:25.055700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.055679 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ddm\" (UniqueName: \"kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm\") pod \"kuadrant-operator-controller-manager-86878c769f-czxjt\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:25.191010 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:25.190972 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:26.639726 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:26.639666 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:26.776797 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:26.776760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:30.561228 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:30.561187 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:30.678132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:30.678093 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:31.182692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:31.182634 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:31.370609 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:31.370575 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:34.675151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.674257 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:27:34.677184 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:34.677137 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ae1cd0_ddf4_4d02_8238_5c92183123e2.slice/crio-2d7d38c58907c28934c95e7278a805e64da046d2d268088444abd1d7ccc88da7 WatchSource:0}: Error finding container 2d7d38c58907c28934c95e7278a805e64da046d2d268088444abd1d7ccc88da7: Status 404 returned error can't find the container with id 2d7d38c58907c28934c95e7278a805e64da046d2d268088444abd1d7ccc88da7 Jul 05 13:27:34.680299 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.680223 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.683124 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.683095 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.684738 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.684716 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.687896 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.687863 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.689858 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.689833 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.754522 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.754490 2569 generic.go:356] "Generic (PLEG): container finished" podID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" containerID="f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53" exitCode=0 Jul 05 13:27:34.754644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.754537 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.754644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.754586 2569 scope.go:117] "RemoveContainer" containerID="f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53" Jul 05 13:27:34.756076 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.756048 2569 generic.go:356] "Generic (PLEG): container finished" podID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" containerID="f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352" exitCode=0 Jul 05 13:27:34.756196 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.756086 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.757013 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.756987 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.757696 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.757673 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" event={"ID":"14056ad7-d1bf-4e25-b7db-7dc35fc97376","Type":"ContainerStarted","Data":"5d9a03433e96a9e339ed5d7dfc0a72a786d4e82cb3ae582d6f896dca58357664"} Jul 05 13:27:34.759116 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.759094 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.759476 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.759456 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" event={"ID":"b8ae1cd0-ddf4-4d02-8238-5c92183123e2","Type":"ContainerStarted","Data":"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555"} Jul 05 13:27:34.759552 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.759495 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" event={"ID":"b8ae1cd0-ddf4-4d02-8238-5c92183123e2","Type":"ContainerStarted","Data":"2d7d38c58907c28934c95e7278a805e64da046d2d268088444abd1d7ccc88da7"} Jul 05 13:27:34.759552 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.759539 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:34.761275 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.761256 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.763557 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.763540 2569 scope.go:117] "RemoveContainer" containerID="f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53" Jul 05 13:27:34.763822 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.763804 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53\": container with ID starting with f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53 not found: ID does not exist" containerID="f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53" Jul 05 13:27:34.763863 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.763829 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53"} err="failed to get container status \"f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53\": rpc error: code = NotFound desc = could not find container \"f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53\": container with ID starting with f5415d1487d11a590d0b510196693911277585b41f07a394d788eb2753d17a53 not found: ID does not exist" Jul 05 13:27:34.763863 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.763845 2569 scope.go:117] "RemoveContainer" containerID="f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352" Jul 05 13:27:34.771132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.771061 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:34.771227 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.771172 2569 scope.go:117] "RemoveContainer" containerID="f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352" Jul 05 13:27:34.771491 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.771458 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352\": container with ID starting with f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352 not found: ID does not exist" containerID="f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352" Jul 05 13:27:34.771559 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.771499 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352"} err="failed to get container status \"f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352\": rpc error: code = NotFound desc = could not find container \"f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352\": container with ID starting with f68490f5c3dbcdbd403d4756f7bcbd533b2db3f342f00480c0b8a49081763352 not found: ID does not exist" Jul 05 13:27:34.779525 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.779492 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ftgg5" podStartSLOduration=1.3138238979999999 podStartE2EDuration="21.779479222s" totalImagesPullingTime="20.465655324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:34.778656724 +0000 UTC m=+546.859572110" watchObservedRunningTime="2026-07-05 13:27:34.779479222 +0000 UTC m=+546.860394611" Jul 05 13:27:34.781602 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.781581 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.808231 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.808186 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" podStartSLOduration=10.808168191 podStartE2EDuration="10.808168191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:34.80732995 +0000 UTC m=+546.888245358" watchObservedRunningTime="2026-07-05 13:27:34.808168191 +0000 UTC m=+546.889083576" Jul 05 13:27:34.810899 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.810874 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:34.813323 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:34.813300 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:34.847691 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.847666 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbt6m\" (UniqueName: \"kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m\") pod \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " Jul 05 13:27:34.847809 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.847724 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume\") pod \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\" (UID: \"7f9125f7-a2e5-4832-a541-a0759aa0e4e0\") " Jul 05 13:27:34.847809 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.847788 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6sqf\" (UniqueName: \"kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf\") pod \"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e\" (UID: \"2d30647a-11d6-4dad-a4b5-2ad5ec3af45e\") " Jul 05 13:27:34.848330 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.848303 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7f9125f7-a2e5-4832-a541-a0759aa0e4e0" (UID: "7f9125f7-a2e5-4832-a541-a0759aa0e4e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:27:34.849780 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.849755 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m" (OuterVolumeSpecName: "kube-api-access-hbt6m") pod "7f9125f7-a2e5-4832-a541-a0759aa0e4e0" (UID: "7f9125f7-a2e5-4832-a541-a0759aa0e4e0"). InnerVolumeSpecName "kube-api-access-hbt6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:27:34.849858 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.849797 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf" (OuterVolumeSpecName: "kube-api-access-x6sqf") pod "2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" (UID: "2d30647a-11d6-4dad-a4b5-2ad5ec3af45e"). InnerVolumeSpecName "kube-api-access-x6sqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:27:34.876199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.876170 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:34.915604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.915578 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc"] Jul 05 13:27:34.918639 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.918618 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:34.919251 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:34.919229 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13960c6c_3284_4bf6_a168_38202524d5de.slice/crio-3e6b12488f18461194e44cc989e4b1703f7ccff26c91ce642f724d07ac236e04 WatchSource:0}: Error finding container 3e6b12488f18461194e44cc989e4b1703f7ccff26c91ce642f724d07ac236e04: Status 404 returned error can't find the container with id 3e6b12488f18461194e44cc989e4b1703f7ccff26c91ce642f724d07ac236e04 Jul 05 13:27:34.920410 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:27:34.920374 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ba5904_d5a9_4938_8bbf_ecc6ef7da65f.slice/crio-aaeb4e624a83577a37e850df367ccb959723f5323d271c2753a0c95c64fca031 WatchSource:0}: Error finding container aaeb4e624a83577a37e850df367ccb959723f5323d271c2753a0c95c64fca031: Status 404 returned error can't find the container with id aaeb4e624a83577a37e850df367ccb959723f5323d271c2753a0c95c64fca031 Jul 05 13:27:34.949190 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.949164 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6sqf\" (UniqueName: \"kubernetes.io/projected/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e-kube-api-access-x6sqf\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:27:34.949271 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.949195 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbt6m\" (UniqueName: \"kubernetes.io/projected/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-kube-api-access-hbt6m\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:27:34.949271 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:34.949209 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9125f7-a2e5-4832-a541-a0759aa0e4e0-extensions-socket-volume\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:27:35.071058 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.071030 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:35.073518 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.073490 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:35.075986 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.075965 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:35.085528 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.085507 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:35.765945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.765856 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" event={"ID":"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f","Type":"ContainerStarted","Data":"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3"} Jul 05 13:27:35.765945 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.765921 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:35.766415 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.765947 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" event={"ID":"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f","Type":"ContainerStarted","Data":"aaeb4e624a83577a37e850df367ccb959723f5323d271c2753a0c95c64fca031"} Jul 05 13:27:35.768755 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.768717 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:35.769427 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.769404 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" event={"ID":"13960c6c-3284-4bf6-a168-38202524d5de","Type":"ContainerStarted","Data":"de1d4df9c63a0d991882f55c3042fa2e57f0009be160b8d8f808d831858da3f9"} Jul 05 13:27:35.769555 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.769442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" event={"ID":"13960c6c-3284-4bf6-a168-38202524d5de","Type":"ContainerStarted","Data":"3e6b12488f18461194e44cc989e4b1703f7ccff26c91ce642f724d07ac236e04"} Jul 05 13:27:35.769622 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.769594 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:35.770833 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.770813 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:35.800937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.800889 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" podStartSLOduration=11.800876055 podStartE2EDuration="11.800876055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:35.799110261 +0000 UTC m=+547.880025675" watchObservedRunningTime="2026-07-05 13:27:35.800876055 +0000 UTC m=+547.881791439" Jul 05 13:27:35.801367 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.801344 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c47zc\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c47zc" Jul 05 13:27:35.829581 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:35.829543 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" podStartSLOduration=11.829530413 podStartE2EDuration="11.829530413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:35.82731832 +0000 UTC m=+547.908233707" watchObservedRunningTime="2026-07-05 13:27:35.829530413 +0000 UTC m=+547.910445798" Jul 05 13:27:35.829684 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:35.829643 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54nqf\" is forbidden: User \"system:node:ip-10-0-128-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-53.ec2.internal' and this object" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54nqf" Jul 05 13:27:36.415337 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:36.415302 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d30647a-11d6-4dad-a4b5-2ad5ec3af45e" path="/var/lib/kubelet/pods/2d30647a-11d6-4dad-a4b5-2ad5ec3af45e/volumes" Jul 05 13:27:36.415669 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:36.415652 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f9125f7-a2e5-4832-a541-a0759aa0e4e0" path="/var/lib/kubelet/pods/7f9125f7-a2e5-4832-a541-a0759aa0e4e0/volumes" Jul 05 13:27:40.897888 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:40.897849 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:40.966265 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:40.966230 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:43.005539 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:43.005506 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:43.109475 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:43.109444 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:45.629597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.629554 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:45.730984 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.730948 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:27:45.772356 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.772323 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:27:45.828444 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.828417 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:45.828630 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.828597 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" podUID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" containerName="manager" containerID="cri-o://6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3" gracePeriod=10 Jul 05 13:27:45.830429 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:45.830407 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:46.080667 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.080637 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:46.247162 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.247083 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9k5k\" (UniqueName: \"kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k\") pod \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " Jul 05 13:27:46.247162 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.247159 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume\") pod \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\" (UID: \"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f\") " Jul 05 13:27:46.247576 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.247553 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" (UID: "84ba5904-d5a9-4938-8bbf-ecc6ef7da65f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:27:46.249132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.249099 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k" (OuterVolumeSpecName: "kube-api-access-x9k5k") pod "84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" (UID: "84ba5904-d5a9-4938-8bbf-ecc6ef7da65f"). InnerVolumeSpecName "kube-api-access-x9k5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:27:46.348038 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.348006 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9k5k\" (UniqueName: \"kubernetes.io/projected/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-kube-api-access-x9k5k\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:27:46.348038 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.348032 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f-extensions-socket-volume\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:27:46.777355 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.777321 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ssrwc" Jul 05 13:27:46.826803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.826774 2569 generic.go:356] "Generic (PLEG): container finished" podID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" containerID="6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3" exitCode=0 Jul 05 13:27:46.826951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.826828 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" Jul 05 13:27:46.826951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.826835 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" event={"ID":"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f","Type":"ContainerDied","Data":"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3"} Jul 05 13:27:46.826951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.826879 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q" event={"ID":"84ba5904-d5a9-4938-8bbf-ecc6ef7da65f","Type":"ContainerDied","Data":"aaeb4e624a83577a37e850df367ccb959723f5323d271c2753a0c95c64fca031"} Jul 05 13:27:46.826951 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.826902 2569 scope.go:117] "RemoveContainer" containerID="6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3" Jul 05 13:27:46.837110 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.836939 2569 scope.go:117] "RemoveContainer" containerID="6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3" Jul 05 13:27:46.837219 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:27:46.837203 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3\": container with ID starting with 6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3 not found: ID does not exist" containerID="6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3" Jul 05 13:27:46.837280 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.837227 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3"} err="failed to get container status \"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3\": rpc error: code = NotFound desc = could not find container \"6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3\": container with ID starting with 6c8b6fbdbadd520e59daa312e21a23086ffcd88740fec764fdd367a7dc91c5c3 not found: ID does not exist" Jul 05 13:27:46.853219 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.853195 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:46.856598 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:46.856580 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8ng9q"] Jul 05 13:27:48.414441 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:27:48.414414 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" path="/var/lib/kubelet/pods/84ba5904-d5a9-4938-8bbf-ecc6ef7da65f/volumes" Jul 05 13:28:04.670026 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:04.669987 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:04.853032 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:04.852995 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:06.373045 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.373003 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:06.373889 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.373869 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:06.374264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.374251 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" containerName="manager" Jul 05 13:28:06.374306 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.374266 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" containerName="manager" Jul 05 13:28:06.374356 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.374348 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ba5904-d5a9-4938-8bbf-ecc6ef7da65f" containerName="manager" Jul 05 13:28:06.414037 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.414007 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.417368 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.417339 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 05 13:28:06.422003 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.421978 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:06.484575 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.484541 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:06.491197 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.491167 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:06.517830 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.517803 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8cgd\" (UniqueName: \"kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.517952 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.517852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.608156 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.608124 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:06.619278 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.619252 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8cgd\" (UniqueName: \"kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.619413 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.619290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.619870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.619852 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.633292 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.633241 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8cgd\" (UniqueName: \"kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd\") pod \"limitador-limitador-64c94fd64f-5dcpc\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.725624 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.725598 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:06.861123 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.861096 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:06.864034 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:28:06.864000 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3273b96a_5eed_46d1_b484_f6350a829038.slice/crio-59ca7dca84409de6d874522b792890f5f592086d73952478b2931909f40c855a WatchSource:0}: Error finding container 59ca7dca84409de6d874522b792890f5f592086d73952478b2931909f40c855a: Status 404 returned error can't find the container with id 59ca7dca84409de6d874522b792890f5f592086d73952478b2931909f40c855a Jul 05 13:28:06.927760 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:06.927735 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" event={"ID":"3273b96a-5eed-46d1-b484-f6350a829038","Type":"ContainerStarted","Data":"59ca7dca84409de6d874522b792890f5f592086d73952478b2931909f40c855a"} Jul 05 13:28:07.218502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.218427 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:07.287125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.287093 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:07.528781 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.528360 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:07.532944 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.532702 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:07.536372 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.535795 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7fvpx\"" Jul 05 13:28:07.541628 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.541574 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:07.628702 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.628630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg2q\" (UniqueName: \"kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q\") pod \"authorino-75d556bd77-kglgk\" (UID: \"b2758f30-8136-418f-9bb1-10aba8c81ae9\") " pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:07.729338 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.729296 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg2q\" (UniqueName: \"kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q\") pod \"authorino-75d556bd77-kglgk\" (UID: \"b2758f30-8136-418f-9bb1-10aba8c81ae9\") " pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:07.738076 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.738042 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg2q\" (UniqueName: \"kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q\") pod \"authorino-75d556bd77-kglgk\" (UID: \"b2758f30-8136-418f-9bb1-10aba8c81ae9\") " pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:07.847139 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.847055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:07.999973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:07.999878 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:08.824740 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:28:08.824699 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2758f30_8136_418f_9bb1_10aba8c81ae9.slice/crio-030fb2501b4c2c07cb6d4867af1dc5823105a0bd521f5f619e9d4b5bc233bc07 WatchSource:0}: Error finding container 030fb2501b4c2c07cb6d4867af1dc5823105a0bd521f5f619e9d4b5bc233bc07: Status 404 returned error can't find the container with id 030fb2501b4c2c07cb6d4867af1dc5823105a0bd521f5f619e9d4b5bc233bc07 Jul 05 13:28:08.941711 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:08.941677 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kglgk" event={"ID":"b2758f30-8136-418f-9bb1-10aba8c81ae9","Type":"ContainerStarted","Data":"030fb2501b4c2c07cb6d4867af1dc5823105a0bd521f5f619e9d4b5bc233bc07"} Jul 05 13:28:09.952900 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:09.952608 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" event={"ID":"3273b96a-5eed-46d1-b484-f6350a829038","Type":"ContainerStarted","Data":"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e"} Jul 05 13:28:09.952900 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:09.952674 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:09.978719 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:09.978609 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" podStartSLOduration=1.4469414139999999 podStartE2EDuration="3.978588254s" totalImagesPullingTime="2.53164684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:09.974200654 +0000 UTC m=+582.055116062" watchObservedRunningTime="2026-07-05 13:28:09.978588254 +0000 UTC m=+582.059503640" Jul 05 13:28:11.968941 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:11.968906 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kglgk" event={"ID":"b2758f30-8136-418f-9bb1-10aba8c81ae9","Type":"ContainerStarted","Data":"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc"} Jul 05 13:28:11.986360 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:11.986305 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kglgk" podStartSLOduration=1.974138329 podStartE2EDuration="4.986289889s" totalImagesPullingTime="3.01215156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:11.984758562 +0000 UTC m=+584.065673960" watchObservedRunningTime="2026-07-05 13:28:11.986289889 +0000 UTC m=+584.067205274" Jul 05 13:28:19.671454 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:19.671410 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:19.738262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:19.738235 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:20.962320 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:20.962288 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:23.463562 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:23.463525 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:23.463990 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:23.463704 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" podUID="3273b96a-5eed-46d1-b484-f6350a829038" containerName="limitador" containerID="cri-o://d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e" gracePeriod=30 Jul 05 13:28:24.013985 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.013961 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:24.030321 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.030259 2569 generic.go:356] "Generic (PLEG): container finished" podID="3273b96a-5eed-46d1-b484-f6350a829038" containerID="d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e" exitCode=0 Jul 05 13:28:24.030321 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.030298 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" Jul 05 13:28:24.030492 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.030327 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" event={"ID":"3273b96a-5eed-46d1-b484-f6350a829038","Type":"ContainerDied","Data":"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e"} Jul 05 13:28:24.030492 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.030374 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dcpc" event={"ID":"3273b96a-5eed-46d1-b484-f6350a829038","Type":"ContainerDied","Data":"59ca7dca84409de6d874522b792890f5f592086d73952478b2931909f40c855a"} Jul 05 13:28:24.030492 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.030407 2569 scope.go:117] "RemoveContainer" containerID="d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e" Jul 05 13:28:24.046149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.046113 2569 scope.go:117] "RemoveContainer" containerID="d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e" Jul 05 13:28:24.046956 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:28:24.046931 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e\": container with ID starting with d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e not found: ID does not exist" containerID="d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e" Jul 05 13:28:24.047116 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.047093 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e"} err="failed to get container status \"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e\": rpc error: code = NotFound desc = could not find container \"d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e\": container with ID starting with d0ebcf38ccd6224d258ee8aace98b438c3dcf3722b5f7415a346d94f9b99ed6e not found: ID does not exist" Jul 05 13:28:24.171231 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.171209 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8cgd\" (UniqueName: \"kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd\") pod \"3273b96a-5eed-46d1-b484-f6350a829038\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " Jul 05 13:28:24.171378 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.171257 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file\") pod \"3273b96a-5eed-46d1-b484-f6350a829038\" (UID: \"3273b96a-5eed-46d1-b484-f6350a829038\") " Jul 05 13:28:24.171654 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.171630 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file" (OuterVolumeSpecName: "config-file") pod "3273b96a-5eed-46d1-b484-f6350a829038" (UID: "3273b96a-5eed-46d1-b484-f6350a829038"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:28:24.173172 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.173152 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd" (OuterVolumeSpecName: "kube-api-access-l8cgd") pod "3273b96a-5eed-46d1-b484-f6350a829038" (UID: "3273b96a-5eed-46d1-b484-f6350a829038"). InnerVolumeSpecName "kube-api-access-l8cgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:28:24.272211 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.272189 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8cgd\" (UniqueName: \"kubernetes.io/projected/3273b96a-5eed-46d1-b484-f6350a829038-kube-api-access-l8cgd\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:28:24.272211 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.272212 2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3273b96a-5eed-46d1-b484-f6350a829038-config-file\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:28:24.352199 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.352174 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:24.358445 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.358424 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dcpc"] Jul 05 13:28:24.415135 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:24.415108 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3273b96a-5eed-46d1-b484-f6350a829038" path="/var/lib/kubelet/pods/3273b96a-5eed-46d1-b484-f6350a829038/volumes" Jul 05 13:28:28.031212 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:28.031180 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:39.877026 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:39.876975 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:40.148927 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:40.148892 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:41.614891 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:41.614857 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:41.615268 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:41.615030 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kglgk" podUID="b2758f30-8136-418f-9bb1-10aba8c81ae9" containerName="authorino" containerID="cri-o://c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc" gracePeriod=30 Jul 05 13:28:41.873348 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:41.873294 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:41.920636 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:41.920600 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzg2q\" (UniqueName: \"kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q\") pod \"b2758f30-8136-418f-9bb1-10aba8c81ae9\" (UID: \"b2758f30-8136-418f-9bb1-10aba8c81ae9\") " Jul 05 13:28:41.922558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:41.922531 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q" (OuterVolumeSpecName: "kube-api-access-hzg2q") pod "b2758f30-8136-418f-9bb1-10aba8c81ae9" (UID: "b2758f30-8136-418f-9bb1-10aba8c81ae9"). InnerVolumeSpecName "kube-api-access-hzg2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:28:42.021974 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.021940 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzg2q\" (UniqueName: \"kubernetes.io/projected/b2758f30-8136-418f-9bb1-10aba8c81ae9-kube-api-access-hzg2q\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:28:42.122683 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.122645 2569 generic.go:356] "Generic (PLEG): container finished" podID="b2758f30-8136-418f-9bb1-10aba8c81ae9" containerID="c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc" exitCode=0 Jul 05 13:28:42.122857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.122698 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kglgk" Jul 05 13:28:42.122857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.122733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kglgk" event={"ID":"b2758f30-8136-418f-9bb1-10aba8c81ae9","Type":"ContainerDied","Data":"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc"} Jul 05 13:28:42.122857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.122779 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kglgk" event={"ID":"b2758f30-8136-418f-9bb1-10aba8c81ae9","Type":"ContainerDied","Data":"030fb2501b4c2c07cb6d4867af1dc5823105a0bd521f5f619e9d4b5bc233bc07"} Jul 05 13:28:42.122857 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.122796 2569 scope.go:117] "RemoveContainer" containerID="c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc" Jul 05 13:28:42.132364 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.132346 2569 scope.go:117] "RemoveContainer" containerID="c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc" Jul 05 13:28:42.132740 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:28:42.132712 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc\": container with ID starting with c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc not found: ID does not exist" containerID="c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc" Jul 05 13:28:42.132839 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.132748 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc"} err="failed to get container status \"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc\": rpc error: code = NotFound desc = could not find container \"c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc\": container with ID starting with c4e4ba9af8a7d41809f994bcaffffa2694ba5be0d842c213a5474a0a6a38b3bc not found: ID does not exist" Jul 05 13:28:42.150677 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.150650 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:42.152731 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.152711 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kglgk"] Jul 05 13:28:42.415306 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:42.415275 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2758f30-8136-418f-9bb1-10aba8c81ae9" path="/var/lib/kubelet/pods/b2758f30-8136-418f-9bb1-10aba8c81ae9/volumes" Jul 05 13:28:49.817882 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.817830 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:49.848237 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848212 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:28:49.848632 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848620 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2758f30-8136-418f-9bb1-10aba8c81ae9" containerName="authorino" Jul 05 13:28:49.848681 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848634 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2758f30-8136-418f-9bb1-10aba8c81ae9" containerName="authorino" Jul 05 13:28:49.848681 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848648 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3273b96a-5eed-46d1-b484-f6350a829038" containerName="limitador" Jul 05 13:28:49.848681 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848653 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3273b96a-5eed-46d1-b484-f6350a829038" containerName="limitador" Jul 05 13:28:49.848772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848754 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3273b96a-5eed-46d1-b484-f6350a829038" containerName="limitador" Jul 05 13:28:49.848772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.848763 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2758f30-8136-418f-9bb1-10aba8c81ae9" containerName="authorino" Jul 05 13:28:49.851802 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.851788 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:49.855077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.855055 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 13:28:49.855280 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.855266 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d7kk4\"" Jul 05 13:28:49.867994 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.867977 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 13:28:49.879438 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.879417 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:28:49.884753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.884735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:49.884840 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.884769 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9tz\" (UniqueName: \"kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:49.930306 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.930252 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:49.985676 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.985653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9tz\" (UniqueName: \"kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:49.985791 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.985774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:49.985904 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:28:49.985889 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 05 13:28:49.985967 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:28:49.985953 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert podName:1c736fa3-03c0-4ad3-a302-40ce6c5a176b nodeName:}" failed. No retries permitted until 2026-07-05 13:28:50.485934425 +0000 UTC m=+622.566849806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert") pod "maas-controller-fbb56d994-h8n54" (UID: "1c736fa3-03c0-4ad3-a302-40ce6c5a176b") : secret "maas-controller-webhook-cert" not found Jul 05 13:28:49.996458 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:49.996431 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9tz\" (UniqueName: \"kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:50.054659 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.054627 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:28:50.058083 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.058067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.075235 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.075165 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:28:50.086264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.086238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.086367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.086301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmgt\" (UniqueName: \"kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.186733 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.186703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.186944 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.186765 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmgt\" (UniqueName: \"kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.189120 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.189087 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.204756 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.204734 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmgt\" (UniqueName: \"kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt\") pod \"maas-controller-7497d7ff7b-2t7qx\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.368875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.368798 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:50.489765 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.489736 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:50.492063 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.492043 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") pod \"maas-controller-fbb56d994-h8n54\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:50.502006 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.501987 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:28:50.504074 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:28:50.504051 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323f298f_81e7_4fce_9174_e7962bf11d01.slice/crio-2f31b8024a7b3deca63de1c3ad4234bf84b3e83033ce8279391a7965f5accacf WatchSource:0}: Error finding container 2f31b8024a7b3deca63de1c3ad4234bf84b3e83033ce8279391a7965f5accacf: Status 404 returned error can't find the container with id 2f31b8024a7b3deca63de1c3ad4234bf84b3e83033ce8279391a7965f5accacf Jul 05 13:28:50.761813 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.761787 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:50.894828 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.894805 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:28:50.896812 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:28:50.896789 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c736fa3_03c0_4ad3_a302_40ce6c5a176b.slice/crio-767353f2a67d422b23c4b7af115548abbe3af6d12501e6d8192f64d8aaef00e2 WatchSource:0}: Error finding container 767353f2a67d422b23c4b7af115548abbe3af6d12501e6d8192f64d8aaef00e2: Status 404 returned error can't find the container with id 767353f2a67d422b23c4b7af115548abbe3af6d12501e6d8192f64d8aaef00e2 Jul 05 13:28:50.966664 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:50.966620 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:51.168803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:51.168758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" event={"ID":"323f298f-81e7-4fce-9174-e7962bf11d01","Type":"ContainerStarted","Data":"2f31b8024a7b3deca63de1c3ad4234bf84b3e83033ce8279391a7965f5accacf"} Jul 05 13:28:51.170290 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:51.170257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbb56d994-h8n54" event={"ID":"1c736fa3-03c0-4ad3-a302-40ce6c5a176b","Type":"ContainerStarted","Data":"767353f2a67d422b23c4b7af115548abbe3af6d12501e6d8192f64d8aaef00e2"} Jul 05 13:28:52.731844 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:52.731811 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:52.836276 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:52.836193 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:28:53.187561 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.187528 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbb56d994-h8n54" event={"ID":"1c736fa3-03c0-4ad3-a302-40ce6c5a176b","Type":"ContainerStarted","Data":"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6"} Jul 05 13:28:53.187757 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.187626 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:28:53.189125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.189096 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" event={"ID":"323f298f-81e7-4fce-9174-e7962bf11d01","Type":"ContainerStarted","Data":"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190"} Jul 05 13:28:53.189262 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.189148 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:28:53.212608 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.212558 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fbb56d994-h8n54" podStartSLOduration=2.588452636 podStartE2EDuration="4.212545925s" totalImagesPullingTime="1.624093289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:53.209828211 +0000 UTC m=+625.290743615" watchObservedRunningTime="2026-07-05 13:28:53.212545925 +0000 UTC m=+625.293461310" Jul 05 13:28:53.234652 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:28:53.234129 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" podStartSLOduration=1.22801677 podStartE2EDuration="3.2341127s" totalImagesPullingTime="2.00609593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:53.233291939 +0000 UTC m=+625.314207332" watchObservedRunningTime="2026-07-05 13:28:53.2341127 +0000 UTC m=+625.315028086" Jul 05 13:29:04.199723 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.199689 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:29:04.200087 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.199756 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:29:04.271410 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.271364 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:29:04.271641 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.271603 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-fbb56d994-h8n54" podUID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" containerName="manager" containerID="cri-o://e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6" gracePeriod=30 Jul 05 13:29:04.527942 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.527917 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:29:04.612538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.612506 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") pod \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " Jul 05 13:29:04.612708 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.612567 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx9tz\" (UniqueName: \"kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz\") pod \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\" (UID: \"1c736fa3-03c0-4ad3-a302-40ce6c5a176b\") " Jul 05 13:29:04.614761 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.614728 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz" (OuterVolumeSpecName: "kube-api-access-sx9tz") pod "1c736fa3-03c0-4ad3-a302-40ce6c5a176b" (UID: "1c736fa3-03c0-4ad3-a302-40ce6c5a176b"). InnerVolumeSpecName "kube-api-access-sx9tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:29:04.614761 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.614744 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1c736fa3-03c0-4ad3-a302-40ce6c5a176b" (UID: "1c736fa3-03c0-4ad3-a302-40ce6c5a176b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:29:04.713777 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.713739 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-webhook-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:29:04.713777 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:04.713771 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx9tz\" (UniqueName: \"kubernetes.io/projected/1c736fa3-03c0-4ad3-a302-40ce6c5a176b-kube-api-access-sx9tz\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:29:05.251294 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.251258 2569 generic.go:356] "Generic (PLEG): container finished" podID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" containerID="e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6" exitCode=0 Jul 05 13:29:05.251715 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.251311 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbb56d994-h8n54" Jul 05 13:29:05.251715 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.251353 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbb56d994-h8n54" event={"ID":"1c736fa3-03c0-4ad3-a302-40ce6c5a176b","Type":"ContainerDied","Data":"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6"} Jul 05 13:29:05.251715 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.251434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbb56d994-h8n54" event={"ID":"1c736fa3-03c0-4ad3-a302-40ce6c5a176b","Type":"ContainerDied","Data":"767353f2a67d422b23c4b7af115548abbe3af6d12501e6d8192f64d8aaef00e2"} Jul 05 13:29:05.251715 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.251459 2569 scope.go:117] "RemoveContainer" containerID="e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6" Jul 05 13:29:05.261827 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.261809 2569 scope.go:117] "RemoveContainer" containerID="e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6" Jul 05 13:29:05.262080 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:29:05.262062 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6\": container with ID starting with e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6 not found: ID does not exist" containerID="e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6" Jul 05 13:29:05.262123 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.262089 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6"} err="failed to get container status \"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6\": rpc error: code = NotFound desc = could not find container \"e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6\": container with ID starting with e2dc1a9bd367a35cc8693df051ce688a0898d0157b9415344f706c66952c2ef6 not found: ID does not exist" Jul 05 13:29:05.275665 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.275639 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:29:05.279846 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:05.279826 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fbb56d994-h8n54"] Jul 05 13:29:06.415361 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:06.415328 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" path="/var/lib/kubelet/pods/1c736fa3-03c0-4ad3-a302-40ce6c5a176b/volumes" Jul 05 13:29:07.175961 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:07.175930 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:24.194036 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.193992 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:24.698645 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.698610 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:24.816899 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.816868 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-85484b5f99-bzxvh"] Jul 05 13:29:24.817297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.817282 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" containerName="manager" Jul 05 13:29:24.817345 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.817298 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" containerName="manager" Jul 05 13:29:24.817406 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.817368 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c736fa3-03c0-4ad3-a302-40ce6c5a176b" containerName="manager" Jul 05 13:29:24.823692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.823676 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:24.827107 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.827085 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\"" Jul 05 13:29:24.827637 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.827621 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 05 13:29:24.855405 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.855360 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85484b5f99-bzxvh"] Jul 05 13:29:24.992729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.992649 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36c8910-e8c8-436c-8182-7bcaa7eced44-openshift-service-ca\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:24.992729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.992692 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36c8910-e8c8-436c-8182-7bcaa7eced44-maas-api-tls\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:24.992729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:24.992718 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl42l\" (UniqueName: \"kubernetes.io/projected/e36c8910-e8c8-436c-8182-7bcaa7eced44-kube-api-access-rl42l\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.093967 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.093933 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36c8910-e8c8-436c-8182-7bcaa7eced44-openshift-service-ca\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.094117 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.093981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36c8910-e8c8-436c-8182-7bcaa7eced44-maas-api-tls\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.094117 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.094001 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl42l\" (UniqueName: \"kubernetes.io/projected/e36c8910-e8c8-436c-8182-7bcaa7eced44-kube-api-access-rl42l\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.094768 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.094748 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36c8910-e8c8-436c-8182-7bcaa7eced44-openshift-service-ca\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.096745 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.096721 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36c8910-e8c8-436c-8182-7bcaa7eced44-maas-api-tls\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.107672 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.107651 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl42l\" (UniqueName: \"kubernetes.io/projected/e36c8910-e8c8-436c-8182-7bcaa7eced44-kube-api-access-rl42l\") pod \"maas-api-85484b5f99-bzxvh\" (UID: \"e36c8910-e8c8-436c-8182-7bcaa7eced44\") " pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.134531 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.134511 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:25.158884 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.158835 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:25.258173 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.258135 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:25.309964 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.309941 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85484b5f99-bzxvh"] Jul 05 13:29:25.313827 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:29:25.313794 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36c8910_e8c8_436c_8182_7bcaa7eced44.slice/crio-73ad757966136a65928c13b5418e0b5c52f49f673cf793b9cd97e2fffca5f076 WatchSource:0}: Error finding container 73ad757966136a65928c13b5418e0b5c52f49f673cf793b9cd97e2fffca5f076: Status 404 returned error can't find the container with id 73ad757966136a65928c13b5418e0b5c52f49f673cf793b9cd97e2fffca5f076 Jul 05 13:29:25.315512 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.315488 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2p8w"] Jul 05 13:29:25.322091 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.322070 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.325646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.325360 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 05 13:29:25.338138 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.338118 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mcppm"] Jul 05 13:29:25.342646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.342628 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2p8w"] Jul 05 13:29:25.342745 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.342727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.345142 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.345123 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vgwnl\"" Jul 05 13:29:25.350405 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.350367 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mcppm"] Jul 05 13:29:25.355041 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.355002 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85484b5f99-bzxvh" event={"ID":"e36c8910-e8c8-436c-8182-7bcaa7eced44","Type":"ContainerStarted","Data":"73ad757966136a65928c13b5418e0b5c52f49f673cf793b9cd97e2fffca5f076"} Jul 05 13:29:25.356005 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.355981 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:25.396132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.396092 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6dr\" (UniqueName: \"kubernetes.io/projected/7dbd752a-a403-42c8-bfe6-c870477bbdd5-kube-api-access-2r6dr\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.396297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.396190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5bf3aa-766d-4e4d-8994-e603de20e516-plugins-config-volume\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.396297 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.396219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dbd752a-a403-42c8-bfe6-c870477bbdd5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.396366 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.396317 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9h47\" (UniqueName: \"kubernetes.io/projected/1d5bf3aa-766d-4e4d-8994-e603de20e516-kube-api-access-p9h47\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.497469 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.497423 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6dr\" (UniqueName: \"kubernetes.io/projected/7dbd752a-a403-42c8-bfe6-c870477bbdd5-kube-api-access-2r6dr\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.497655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.497506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5bf3aa-766d-4e4d-8994-e603de20e516-plugins-config-volume\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.497655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.497531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dbd752a-a403-42c8-bfe6-c870477bbdd5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.497774 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.497668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9h47\" (UniqueName: \"kubernetes.io/projected/1d5bf3aa-766d-4e4d-8994-e603de20e516-kube-api-access-p9h47\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.498398 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.498363 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dbd752a-a403-42c8-bfe6-c870477bbdd5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.498508 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.498447 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5bf3aa-766d-4e4d-8994-e603de20e516-plugins-config-volume\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.509121 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.509065 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9h47\" (UniqueName: \"kubernetes.io/projected/1d5bf3aa-766d-4e4d-8994-e603de20e516-kube-api-access-p9h47\") pod \"payload-processing-58f86c7798-mcppm\" (UID: \"1d5bf3aa-766d-4e4d-8994-e603de20e516\") " pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.509298 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.509282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6dr\" (UniqueName: \"kubernetes.io/projected/7dbd752a-a403-42c8-bfe6-c870477bbdd5-kube-api-access-2r6dr\") pod \"payload-pre-processing-7964457696-h2p8w\" (UID: \"7dbd752a-a403-42c8-bfe6-c870477bbdd5\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.635086 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.635049 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:25.657494 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.657465 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:25.790878 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.790854 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2p8w"] Jul 05 13:29:25.794043 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:29:25.794010 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbd752a_a403_42c8_bfe6_c870477bbdd5.slice/crio-d1f6e24433865fac4df0dcd95d7724a5c120ae64d1f140fc890aba88348f3766 WatchSource:0}: Error finding container d1f6e24433865fac4df0dcd95d7724a5c120ae64d1f140fc890aba88348f3766: Status 404 returned error can't find the container with id d1f6e24433865fac4df0dcd95d7724a5c120ae64d1f140fc890aba88348f3766 Jul 05 13:29:25.809775 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:25.809754 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mcppm"] Jul 05 13:29:25.811778 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:29:25.811747 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5bf3aa_766d_4e4d_8994_e603de20e516.slice/crio-c2025a7b1ff9979fdad63cf245646a7fc23d6af5e918ae1f830a632efd9ebf6c WatchSource:0}: Error finding container c2025a7b1ff9979fdad63cf245646a7fc23d6af5e918ae1f830a632efd9ebf6c: Status 404 returned error can't find the container with id c2025a7b1ff9979fdad63cf245646a7fc23d6af5e918ae1f830a632efd9ebf6c Jul 05 13:29:26.364062 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:26.364024 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" event={"ID":"7dbd752a-a403-42c8-bfe6-c870477bbdd5","Type":"ContainerStarted","Data":"d1f6e24433865fac4df0dcd95d7724a5c120ae64d1f140fc890aba88348f3766"} Jul 05 13:29:26.366451 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:26.366419 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" event={"ID":"1d5bf3aa-766d-4e4d-8994-e603de20e516","Type":"ContainerStarted","Data":"c2025a7b1ff9979fdad63cf245646a7fc23d6af5e918ae1f830a632efd9ebf6c"} Jul 05 13:29:27.374644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.374605 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85484b5f99-bzxvh" event={"ID":"e36c8910-e8c8-436c-8182-7bcaa7eced44","Type":"ContainerStarted","Data":"d8b4ff52ad11c8fe582578cba38cbb371d8003016d11881c95a57af917379adf"} Jul 05 13:29:27.375091 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.374788 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:27.376333 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.376311 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" event={"ID":"7dbd752a-a403-42c8-bfe6-c870477bbdd5","Type":"ContainerStarted","Data":"73e6312b92f0561430c2d1b224bba7009407c2cfc82eafb1f0ef0ae80ec443b9"} Jul 05 13:29:27.376459 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.376402 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:27.377869 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.377848 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" event={"ID":"1d5bf3aa-766d-4e4d-8994-e603de20e516","Type":"ContainerStarted","Data":"40f3d1d2af55fa515739829aa813c5fcb33b5f3fb3dafbd6afbbeee116555629"} Jul 05 13:29:27.377993 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.377913 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:27.392691 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.392655 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-85484b5f99-bzxvh" podStartSLOduration=1.5553584790000001 podStartE2EDuration="3.392642402s" totalImagesPullingTime="1.837283923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:27.391209809 +0000 UTC m=+659.472125195" watchObservedRunningTime="2026-07-05 13:29:27.392642402 +0000 UTC m=+659.473557779" Jul 05 13:29:27.407814 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.407346 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" podStartSLOduration=1.048176033 podStartE2EDuration="2.407329995s" totalImagesPullingTime="1.359153962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:27.405628207 +0000 UTC m=+659.486543603" watchObservedRunningTime="2026-07-05 13:29:27.407329995 +0000 UTC m=+659.488245382" Jul 05 13:29:27.421733 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:27.421563 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" podStartSLOduration=1.082196705 podStartE2EDuration="2.421539161s" totalImagesPullingTime="1.339342456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:27.421284655 +0000 UTC m=+659.502200040" watchObservedRunningTime="2026-07-05 13:29:27.421539161 +0000 UTC m=+659.502454538" Jul 05 13:29:33.391177 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:33.391149 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-85484b5f99-bzxvh" Jul 05 13:29:34.359937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:34.359899 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:34.460760 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:34.460728 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:29:38.387643 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:38.387612 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mcppm" Jul 05 13:29:38.388203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:38.388182 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-h2p8w" Jul 05 13:29:55.216804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:29:55.216763 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:00.173489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.173451 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29720970-jgbx8"] Jul 05 13:30:00.179792 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.179773 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:00.186266 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.186229 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720970-jgbx8"] Jul 05 13:30:00.299151 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.299116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxlk\" (UniqueName: \"kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk\") pod \"maas-api-key-cleanup-29720970-jgbx8\" (UID: \"41663662-71c5-4c7f-850b-87479962c0a7\") " pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:00.400320 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.400284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxlk\" (UniqueName: \"kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk\") pod \"maas-api-key-cleanup-29720970-jgbx8\" (UID: \"41663662-71c5-4c7f-850b-87479962c0a7\") " pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:00.410588 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.410561 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxlk\" (UniqueName: \"kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk\") pod \"maas-api-key-cleanup-29720970-jgbx8\" (UID: \"41663662-71c5-4c7f-850b-87479962c0a7\") " pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:00.490985 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.490910 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:00.833843 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.833769 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720970-jgbx8"] Jul 05 13:30:00.837627 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:30:00.837596 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41663662_71c5_4c7f_850b_87479962c0a7.slice/crio-2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33 WatchSource:0}: Error finding container 2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33: Status 404 returned error can't find the container with id 2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33 Jul 05 13:30:00.839505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:00.839489 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:30:01.546339 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:01.546303 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" event={"ID":"41663662-71c5-4c7f-850b-87479962c0a7","Type":"ContainerStarted","Data":"2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33"} Jul 05 13:30:04.564419 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:04.564365 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" event={"ID":"41663662-71c5-4c7f-850b-87479962c0a7","Type":"ContainerStarted","Data":"cbecbaefa5b7931e971aafcf1e2b1f72b4d76daa84a30182665d85d3e82933c8"} Jul 05 13:30:05.389983 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.389952 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc"] Jul 05 13:30:05.393591 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.393574 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.396604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.396579 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 05 13:30:05.396704 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.396585 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 05 13:30:05.397607 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.397587 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bmbgn\"" Jul 05 13:30:05.397733 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.397620 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 05 13:30:05.405919 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.405892 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc"] Jul 05 13:30:05.420664 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.420629 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:05.547148 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.547310 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfnb\" (UniqueName: \"kubernetes.io/projected/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-kube-api-access-9sfnb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.547310 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.547551 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.547655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.547655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.547592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.571700 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.571669 2569 generic.go:356] "Generic (PLEG): container finished" podID="41663662-71c5-4c7f-850b-87479962c0a7" containerID="cbecbaefa5b7931e971aafcf1e2b1f72b4d76daa84a30182665d85d3e82933c8" exitCode=0 Jul 05 13:30:05.572139 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.571714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" event={"ID":"41663662-71c5-4c7f-850b-87479962c0a7","Type":"ContainerDied","Data":"cbecbaefa5b7931e971aafcf1e2b1f72b4d76daa84a30182665d85d3e82933c8"} Jul 05 13:30:05.648424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfnb\" (UniqueName: \"kubernetes.io/projected/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-kube-api-access-9sfnb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.648585 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.648650 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648630 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.648709 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648658 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.648709 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.648814 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.648756 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.649152 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.649123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.649347 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.649173 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.650355 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.650335 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.651251 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.651224 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.651797 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.651779 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.657753 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.657731 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfnb\" (UniqueName: \"kubernetes.io/projected/c5981e21-94a9-4e80-bc6b-9660ad46fb4f-kube-api-access-9sfnb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc\" (UID: \"c5981e21-94a9-4e80-bc6b-9660ad46fb4f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.705698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.705674 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:05.705935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.705914 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:05.846231 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.846207 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc"] Jul 05 13:30:05.847753 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:30:05.847726 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5981e21_94a9_4e80_bc6b_9660ad46fb4f.slice/crio-d812713d0dca536142a316c56e8ce9991e2ea8d20c98d171eb5d25e5ec042b7c WatchSource:0}: Error finding container d812713d0dca536142a316c56e8ce9991e2ea8d20c98d171eb5d25e5ec042b7c: Status 404 returned error can't find the container with id d812713d0dca536142a316c56e8ce9991e2ea8d20c98d171eb5d25e5ec042b7c Jul 05 13:30:05.849671 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.849652 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfxlk\" (UniqueName: \"kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk\") pod \"41663662-71c5-4c7f-850b-87479962c0a7\" (UID: \"41663662-71c5-4c7f-850b-87479962c0a7\") " Jul 05 13:30:05.851617 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.851597 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk" (OuterVolumeSpecName: "kube-api-access-pfxlk") pod "41663662-71c5-4c7f-850b-87479962c0a7" (UID: "41663662-71c5-4c7f-850b-87479962c0a7"). InnerVolumeSpecName "kube-api-access-pfxlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:30:05.950482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:05.950405 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfxlk\" (UniqueName: \"kubernetes.io/projected/41663662-71c5-4c7f-850b-87479962c0a7-kube-api-access-pfxlk\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:30:06.577937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:06.577904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" event={"ID":"41663662-71c5-4c7f-850b-87479962c0a7","Type":"ContainerDied","Data":"2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33"} Jul 05 13:30:06.578371 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:06.577957 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e7fe43196875d03442b329bb1125f46280ea1df80deae923aeda7a785e53f33" Jul 05 13:30:06.578371 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:06.577911 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720970-jgbx8" Jul 05 13:30:06.579351 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:06.579327 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" event={"ID":"c5981e21-94a9-4e80-bc6b-9660ad46fb4f","Type":"ContainerStarted","Data":"d812713d0dca536142a316c56e8ce9991e2ea8d20c98d171eb5d25e5ec042b7c"} Jul 05 13:30:07.585692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:07.585652 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" event={"ID":"c5981e21-94a9-4e80-bc6b-9660ad46fb4f","Type":"ContainerStarted","Data":"07ab0047e3481a362cc81e5c10b8d7e1b2ee35bd1543b6c278152e9ffda37618"} Jul 05 13:30:07.607059 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:07.607001 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" podStartSLOduration=1.494619159 podStartE2EDuration="2.606985649s" totalImagesPullingTime="1.11236649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:30:07.605819538 +0000 UTC m=+699.686734922" watchObservedRunningTime="2026-07-05 13:30:07.606985649 +0000 UTC m=+699.687901034" Jul 05 13:30:08.115935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:08.115899 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:15.707056 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:15.707014 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:15.707472 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:15.707124 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:15.719367 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:15.719338 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:16.643309 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:16.643282 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc" Jul 05 13:30:19.714330 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.714295 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc"] Jul 05 13:30:19.714778 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.714763 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41663662-71c5-4c7f-850b-87479962c0a7" containerName="cleanup" Jul 05 13:30:19.714778 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.714780 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="41663662-71c5-4c7f-850b-87479962c0a7" containerName="cleanup" Jul 05 13:30:19.714875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.714866 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="41663662-71c5-4c7f-850b-87479962c0a7" containerName="cleanup" Jul 05 13:30:19.718125 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.718105 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.720972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.720951 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 05 13:30:19.730952 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.730932 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc"] Jul 05 13:30:19.751562 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.751530 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:19.773946 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.773899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.774107 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.773962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.774107 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.773997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.774107 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.774026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.774107 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.774087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wjhc\" (UniqueName: \"kubernetes.io/projected/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-kube-api-access-8wjhc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.774307 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.774157 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875564 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.875663 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.875611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wjhc\" (UniqueName: \"kubernetes.io/projected/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-kube-api-access-8wjhc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.876040 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.876014 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.876040 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.876035 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.876183 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.876107 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.877915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.877893 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.878171 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.878157 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:19.886249 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:19.886229 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wjhc\" (UniqueName: \"kubernetes.io/projected/dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1-kube-api-access-8wjhc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtc\" (UID: \"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:20.028353 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:20.028238 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:20.169375 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:20.169341 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc"] Jul 05 13:30:20.172891 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:30:20.172849 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2b6ca6_2d20_4e71_afba_90dc64f7ccf1.slice/crio-e85f6d87e724b2d56e9f6dee3cfe2a96e741f12a751a150793b840fe9be11c2b WatchSource:0}: Error finding container e85f6d87e724b2d56e9f6dee3cfe2a96e741f12a751a150793b840fe9be11c2b: Status 404 returned error can't find the container with id e85f6d87e724b2d56e9f6dee3cfe2a96e741f12a751a150793b840fe9be11c2b Jul 05 13:30:20.655338 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:20.655307 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" event={"ID":"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1","Type":"ContainerStarted","Data":"9f6bfa7aa6c07d6f5d2ed41f77057957a03daf49956ccd84ff6c0a7b7fd79f41"} Jul 05 13:30:20.655520 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:20.655357 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" event={"ID":"dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1","Type":"ContainerStarted","Data":"e85f6d87e724b2d56e9f6dee3cfe2a96e741f12a751a150793b840fe9be11c2b"} Jul 05 13:30:20.675568 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:20.675519 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" podStartSLOduration=1.513870041 podStartE2EDuration="1.675504641s" totalImagesPullingTime="161.6346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:30:20.674363929 +0000 UTC m=+712.755279316" watchObservedRunningTime="2026-07-05 13:30:20.675504641 +0000 UTC m=+712.756420025" Jul 05 13:30:22.242061 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:22.242019 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:22.343325 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:22.343283 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:28.970634 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:28.970600 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:30.028635 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:30.028602 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:30.029012 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:30.028664 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:30.041015 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:30.040990 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:30.718772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:30.718744 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtc" Jul 05 13:30:31.997913 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:31.997871 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc"] Jul 05 13:30:32.001972 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.001948 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.004859 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.004838 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 05 13:30:32.010785 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.010761 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc"] Jul 05 13:30:32.030140 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.030115 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:32.087261 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087226 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.087420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.087420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg669\" (UniqueName: \"kubernetes.io/projected/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-kube-api-access-mg669\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.087420 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087369 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.087547 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087431 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.087547 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.087496 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188480 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188446 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188508 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg669\" (UniqueName: \"kubernetes.io/projected/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-kube-api-access-mg669\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188658 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.188937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188922 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.189020 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.188998 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.189058 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.189025 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.190803 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.190782 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.191052 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.191036 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.196719 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.196693 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg669\" (UniqueName: \"kubernetes.io/projected/5ccbe8ff-e3e4-457f-bd0f-26a5afd53548-kube-api-access-mg669\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc\" (UID: \"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.314247 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.314169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:32.452105 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.452081 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc"] Jul 05 13:30:32.454355 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:30:32.454328 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccbe8ff_e3e4_457f_bd0f_26a5afd53548.slice/crio-09fe301bac8db4cd155154a650ef9c5dad427fc0d4b19ae56c5fd63ead747053 WatchSource:0}: Error finding container 09fe301bac8db4cd155154a650ef9c5dad427fc0d4b19ae56c5fd63ead747053: Status 404 returned error can't find the container with id 09fe301bac8db4cd155154a650ef9c5dad427fc0d4b19ae56c5fd63ead747053 Jul 05 13:30:32.719834 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.719799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" event={"ID":"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548","Type":"ContainerStarted","Data":"61dd2acc2144cb52e81ed1b112bcc5c7b9108d478c394776376921430e3037db"} Jul 05 13:30:32.719969 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.719860 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" event={"ID":"5ccbe8ff-e3e4-457f-bd0f-26a5afd53548","Type":"ContainerStarted","Data":"09fe301bac8db4cd155154a650ef9c5dad427fc0d4b19ae56c5fd63ead747053"} Jul 05 13:30:32.740146 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:32.740096 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" podStartSLOduration=1.5753603969999999 podStartE2EDuration="1.740078876s" totalImagesPullingTime="164.718479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:30:32.738840696 +0000 UTC m=+724.819756081" watchObservedRunningTime="2026-07-05 13:30:32.740078876 +0000 UTC m=+724.820994261" Jul 05 13:30:42.315025 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:42.314986 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:42.315467 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:42.315066 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:42.327688 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:42.327666 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:42.783901 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:42.783869 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc" Jul 05 13:30:53.860538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:53.860498 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:30:59.724201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:30:59.724161 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:32:01.495101 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:32:01.495018 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:32:38.796732 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:32:38.796693 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:32:38.894318 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:32:38.894273 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:32:39.999685 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:32:39.999652 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:32:40.114245 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:32:40.114196 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:33:50.915768 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:50.915731 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:33:51.017413 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.017365 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:33:51.017613 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.017580 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" podUID="323f298f-81e7-4fce-9174-e7962bf11d01" containerName="manager" containerID="cri-o://7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190" gracePeriod=30 Jul 05 13:33:51.262879 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.262856 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:33:51.315448 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.315418 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flmgt\" (UniqueName: \"kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt\") pod \"323f298f-81e7-4fce-9174-e7962bf11d01\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " Jul 05 13:33:51.315604 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.315457 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert\") pod \"323f298f-81e7-4fce-9174-e7962bf11d01\" (UID: \"323f298f-81e7-4fce-9174-e7962bf11d01\") " Jul 05 13:33:51.317412 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.317353 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt" (OuterVolumeSpecName: "kube-api-access-flmgt") pod "323f298f-81e7-4fce-9174-e7962bf11d01" (UID: "323f298f-81e7-4fce-9174-e7962bf11d01"). InnerVolumeSpecName "kube-api-access-flmgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:33:51.317526 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.317492 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "323f298f-81e7-4fce-9174-e7962bf11d01" (UID: "323f298f-81e7-4fce-9174-e7962bf11d01"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:33:51.416694 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.416666 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flmgt\" (UniqueName: \"kubernetes.io/projected/323f298f-81e7-4fce-9174-e7962bf11d01-kube-api-access-flmgt\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:33:51.416694 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.416690 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/323f298f-81e7-4fce-9174-e7962bf11d01-webhook-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:33:51.750600 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.750566 2569 generic.go:356] "Generic (PLEG): container finished" podID="323f298f-81e7-4fce-9174-e7962bf11d01" containerID="7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190" exitCode=0 Jul 05 13:33:51.750805 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.750618 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" Jul 05 13:33:51.750805 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.750650 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" event={"ID":"323f298f-81e7-4fce-9174-e7962bf11d01","Type":"ContainerDied","Data":"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190"} Jul 05 13:33:51.750805 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.750707 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-2t7qx" event={"ID":"323f298f-81e7-4fce-9174-e7962bf11d01","Type":"ContainerDied","Data":"2f31b8024a7b3deca63de1c3ad4234bf84b3e83033ce8279391a7965f5accacf"} Jul 05 13:33:51.750805 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.750731 2569 scope.go:117] "RemoveContainer" containerID="7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190" Jul 05 13:33:51.763010 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.762985 2569 scope.go:117] "RemoveContainer" containerID="7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190" Jul 05 13:33:51.763528 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:33:51.763506 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190\": container with ID starting with 7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190 not found: ID does not exist" containerID="7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190" Jul 05 13:33:51.763634 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.763534 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190"} err="failed to get container status \"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190\": rpc error: code = NotFound desc = could not find container \"7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190\": container with ID starting with 7c42db57fab9081f49632a57aedd887313c31902712cd98d4221aa8c5f78b190 not found: ID does not exist" Jul 05 13:33:51.784147 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.784118 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:33:51.792014 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:51.791993 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-2t7qx"] Jul 05 13:33:52.415403 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.415353 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323f298f-81e7-4fce-9174-e7962bf11d01" path="/var/lib/kubelet/pods/323f298f-81e7-4fce-9174-e7962bf11d01/volumes" Jul 05 13:33:52.459045 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.459012 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:33:52.578589 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.578552 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-ntbmm"] Jul 05 13:33:52.579098 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.579076 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323f298f-81e7-4fce-9174-e7962bf11d01" containerName="manager" Jul 05 13:33:52.579098 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.579097 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="323f298f-81e7-4fce-9174-e7962bf11d01" containerName="manager" Jul 05 13:33:52.579286 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.579206 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="323f298f-81e7-4fce-9174-e7962bf11d01" containerName="manager" Jul 05 13:33:52.583684 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.583664 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.587597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.587551 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d7kk4\"" Jul 05 13:33:52.587597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.587576 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 13:33:52.587856 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.587776 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 13:33:52.590289 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.590269 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-ntbmm"] Jul 05 13:33:52.626769 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.626744 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw5n8\" (UniqueName: \"kubernetes.io/projected/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-kube-api-access-fw5n8\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.626922 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.626781 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-webhook-cert\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.727650 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.727576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5n8\" (UniqueName: \"kubernetes.io/projected/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-kube-api-access-fw5n8\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.727650 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.727613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-webhook-cert\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.729992 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.729973 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-webhook-cert\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.736833 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.736815 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5n8\" (UniqueName: \"kubernetes.io/projected/fd43a46b-99d4-4cc7-9d1d-2dc816fa994e-kube-api-access-fw5n8\") pod \"maas-controller-7497d7ff7b-ntbmm\" (UID: \"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e\") " pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:52.894885 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:52.894855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:53.026363 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:53.026338 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7497d7ff7b-ntbmm"] Jul 05 13:33:53.028863 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:33:53.028837 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd43a46b_99d4_4cc7_9d1d_2dc816fa994e.slice/crio-4c4616216a3ccb375a26a46c26961d3d023ec08606089bb9aac290d5bb2c87c9 WatchSource:0}: Error finding container 4c4616216a3ccb375a26a46c26961d3d023ec08606089bb9aac290d5bb2c87c9: Status 404 returned error can't find the container with id 4c4616216a3ccb375a26a46c26961d3d023ec08606089bb9aac290d5bb2c87c9 Jul 05 13:33:53.764345 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:53.764256 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" event={"ID":"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e","Type":"ContainerStarted","Data":"3d0a52e0996d2fe71f0b748f168ea91111d3285f3a48f0ef9991c7eb6cd6c45a"} Jul 05 13:33:53.764345 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:53.764304 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" event={"ID":"fd43a46b-99d4-4cc7-9d1d-2dc816fa994e","Type":"ContainerStarted","Data":"4c4616216a3ccb375a26a46c26961d3d023ec08606089bb9aac290d5bb2c87c9"} Jul 05 13:33:53.764817 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:53.764344 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:33:53.783667 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:33:53.783629 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" podStartSLOduration=1.386721907 podStartE2EDuration="1.78361485s" totalImagesPullingTime="396.892943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:33:53.781510898 +0000 UTC m=+925.862426307" watchObservedRunningTime="2026-07-05 13:33:53.78361485 +0000 UTC m=+925.864530235" Jul 05 13:34:04.775206 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:04.775176 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7497d7ff7b-ntbmm" Jul 05 13:34:31.277448 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:31.277398 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:31.372028 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:31.371979 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:31.500773 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:31.500742 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:37.230677 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:37.230644 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:37.334673 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:37.334634 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:37.440047 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:37.440007 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:37.579076 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:37.578994 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:43.280646 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:43.280615 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:43.395459 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:43.395422 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:34:50.027650 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:34:50.027551 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:35:21.384089 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:35:21.384056 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:35:40.467699 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:35:40.467668 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:35:40.526006 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:35:40.525969 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:36:01.115049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:36:01.115015 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:38:32.557108 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:32.557074 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:38:32.557636 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:32.557263 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" podUID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" containerName="manager" containerID="cri-o://f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555" gracePeriod=10 Jul 05 13:38:35.015728 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.015702 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:38:35.067823 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.067787 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume\") pod \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " Jul 05 13:38:35.067823 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.067823 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45ddm\" (UniqueName: \"kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm\") pod \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\" (UID: \"b8ae1cd0-ddf4-4d02-8238-5c92183123e2\") " Jul 05 13:38:35.068256 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.068226 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8ae1cd0-ddf4-4d02-8238-5c92183123e2" (UID: "b8ae1cd0-ddf4-4d02-8238-5c92183123e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:38:35.069851 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.069824 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm" (OuterVolumeSpecName: "kube-api-access-45ddm") pod "b8ae1cd0-ddf4-4d02-8238-5c92183123e2" (UID: "b8ae1cd0-ddf4-4d02-8238-5c92183123e2"). InnerVolumeSpecName "kube-api-access-45ddm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:38:35.169491 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.169458 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-extensions-socket-volume\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:38:35.169491 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.169483 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45ddm\" (UniqueName: \"kubernetes.io/projected/b8ae1cd0-ddf4-4d02-8238-5c92183123e2-kube-api-access-45ddm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:38:35.268558 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.268516 2569 generic.go:356] "Generic (PLEG): container finished" podID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" containerID="f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555" exitCode=0 Jul 05 13:38:35.268743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.268569 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" Jul 05 13:38:35.268743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.268601 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" event={"ID":"b8ae1cd0-ddf4-4d02-8238-5c92183123e2","Type":"ContainerDied","Data":"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555"} Jul 05 13:38:35.268743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.268654 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt" event={"ID":"b8ae1cd0-ddf4-4d02-8238-5c92183123e2","Type":"ContainerDied","Data":"2d7d38c58907c28934c95e7278a805e64da046d2d268088444abd1d7ccc88da7"} Jul 05 13:38:35.268743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.268682 2569 scope.go:117] "RemoveContainer" containerID="f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555" Jul 05 13:38:35.278804 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.278785 2569 scope.go:117] "RemoveContainer" containerID="f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555" Jul 05 13:38:35.279050 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:38:35.279033 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555\": container with ID starting with f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555 not found: ID does not exist" containerID="f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555" Jul 05 13:38:35.279090 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.279060 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555"} err="failed to get container status \"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555\": rpc error: code = NotFound desc = could not find container \"f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555\": container with ID starting with f7724133e755599fc1bd6fb01d5ef58d682025fbaad18708f532650a5dce5555 not found: ID does not exist" Jul 05 13:38:35.291066 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.291045 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:38:35.295162 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:35.295140 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-czxjt"] Jul 05 13:38:36.414891 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:38:36.414858 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" path="/var/lib/kubelet/pods/b8ae1cd0-ddf4-4d02-8238-5c92183123e2/volumes" Jul 05 13:39:33.702375 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.702338 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt"] Jul 05 13:39:33.702839 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.702801 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" containerName="manager" Jul 05 13:39:33.702839 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.702815 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" containerName="manager" Jul 05 13:39:33.702915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.702893 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ae1cd0-ddf4-4d02-8238-5c92183123e2" containerName="manager" Jul 05 13:39:33.706024 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.706009 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.709298 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.709278 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n9ml6\"" Jul 05 13:39:33.720264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.720242 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt"] Jul 05 13:39:33.786182 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.786156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58772690-61a6-4f45-af1c-22e31079487d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.786299 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.786209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxbs8\" (UniqueName: \"kubernetes.io/projected/58772690-61a6-4f45-af1c-22e31079487d-kube-api-access-xxbs8\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.886698 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.886668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxbs8\" (UniqueName: \"kubernetes.io/projected/58772690-61a6-4f45-af1c-22e31079487d-kube-api-access-xxbs8\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.886805 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.886745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58772690-61a6-4f45-af1c-22e31079487d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.887045 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.887029 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58772690-61a6-4f45-af1c-22e31079487d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:33.894984 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:33.894963 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxbs8\" (UniqueName: \"kubernetes.io/projected/58772690-61a6-4f45-af1c-22e31079487d-kube-api-access-xxbs8\") pod \"kuadrant-operator-controller-manager-86878c769f-6xqdt\" (UID: \"58772690-61a6-4f45-af1c-22e31079487d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:34.016513 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.016452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:34.359561 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.359531 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt"] Jul 05 13:39:34.360450 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:39:34.360419 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58772690_61a6_4f45_af1c_22e31079487d.slice/crio-d248abb09ff637b89855a775dee2197b6d1a7b799f82d4f3bd91d0b826a2f12d WatchSource:0}: Error finding container d248abb09ff637b89855a775dee2197b6d1a7b799f82d4f3bd91d0b826a2f12d: Status 404 returned error can't find the container with id d248abb09ff637b89855a775dee2197b6d1a7b799f82d4f3bd91d0b826a2f12d Jul 05 13:39:34.577051 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.577023 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" event={"ID":"58772690-61a6-4f45-af1c-22e31079487d","Type":"ContainerStarted","Data":"fadf774febd7e708ec736ca80af3946c00a01f82cce65e31ba9db255a4d1024b"} Jul 05 13:39:34.577178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.577071 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" event={"ID":"58772690-61a6-4f45-af1c-22e31079487d","Type":"ContainerStarted","Data":"d248abb09ff637b89855a775dee2197b6d1a7b799f82d4f3bd91d0b826a2f12d"} Jul 05 13:39:34.577178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.577164 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:39:34.595824 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:34.595788 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" podStartSLOduration=1.595775353 podStartE2EDuration="1.595775353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:39:34.59475432 +0000 UTC m=+1266.675669705" watchObservedRunningTime="2026-07-05 13:39:34.595775353 +0000 UTC m=+1266.676690738" Jul 05 13:39:45.585443 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:39:45.585414 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6xqdt" Jul 05 13:42:05.814216 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:42:05.814173 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:42:06.743618 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:42:06.743586 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:42:33.820409 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:42:33.820356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:42:33.921847 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:42:33.921802 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:43:55.106755 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:43:55.106652 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:44:13.313400 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:44:13.313351 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:21.946194 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:21.946114 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:32.772568 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:32.772518 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:41.037216 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:41.037181 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:46.156627 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:46.156591 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:49.028188 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:49.028145 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:49.124239 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:49.124200 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:49.483393 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:49.483356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:55.592193 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:55.592164 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:55.671070 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:55.671004 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:55.845156 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:55.845070 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:55.955643 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:55.955605 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:57.155179 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.155140 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:57.219795 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.219761 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:45:57.224328 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.224309 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.228677 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.228657 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-72122384-serving-cert\"" Jul 05 13:45:57.245482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.245458 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:45:57.299040 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.299013 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:57.327729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.327705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.327836 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.327765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52g6f\" (UniqueName: \"kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.327898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.327878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.425831 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.425765 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:57.428911 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.428893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52g6f\" (UniqueName: \"kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.428973 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.428952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.429014 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.428999 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.429122 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:45:57.429106 2569 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-72122384-serving-cert: secret "maas-api-e2e-ait-72122384-serving-cert" not found Jul 05 13:45:57.429203 ip-10-0-128-53 kubenswrapper[2569]: E0705 13:45:57.429193 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls podName:b99ac245-0673-423b-919a-4ac6afda5e2a nodeName:}" failed. No retries permitted until 2026-07-05 13:45:57.929178122 +0000 UTC m=+1650.010093494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls") pod "maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" (UID: "b99ac245-0673-423b-919a-4ac6afda5e2a") : secret "maas-api-e2e-ait-72122384-serving-cert" not found Jul 05 13:45:57.429615 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.429598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.444788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.444757 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52g6f\" (UniqueName: \"kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.684875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.684791 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:57.934178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.934147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:57.936685 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:57.936628 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") pod \"maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:58.134515 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.134483 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:58.134829 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.134795 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:58.238984 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.238948 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:58.282061 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.282039 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:45:58.284459 ip-10-0-128-53 kubenswrapper[2569]: W0705 13:45:58.284430 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99ac245_0673_423b_919a_4ac6afda5e2a.slice/crio-613082c68fa6da0a3410185bea01daca9dcee87093828b880a5f6d87081f98ec WatchSource:0}: Error finding container 613082c68fa6da0a3410185bea01daca9dcee87093828b880a5f6d87081f98ec: Status 404 returned error can't find the container with id 613082c68fa6da0a3410185bea01daca9dcee87093828b880a5f6d87081f98ec Jul 05 13:45:58.285821 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.285804 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:45:58.597179 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:58.597095 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" event={"ID":"b99ac245-0673-423b-919a-4ac6afda5e2a","Type":"ContainerStarted","Data":"613082c68fa6da0a3410185bea01daca9dcee87093828b880a5f6d87081f98ec"} Jul 05 13:45:59.318230 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:59.318200 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:45:59.603463 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:59.603356 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" event={"ID":"b99ac245-0673-423b-919a-4ac6afda5e2a","Type":"ContainerStarted","Data":"0da65b360b2104d7aabfec7081d53d14d8a4a98f78dc62829fa94cdfcc9f66a9"} Jul 05 13:45:59.603620 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:59.603559 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:45:59.622606 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:45:59.622560 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" podStartSLOduration=2.175036008 podStartE2EDuration="2.622545633s" totalImagesPullingTime="447.509625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:45:59.620454463 +0000 UTC m=+1651.701369869" watchObservedRunningTime="2026-07-05 13:45:59.622545633 +0000 UTC m=+1651.703461017" Jul 05 13:46:02.129227 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.129192 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:02.304128 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.304097 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:02.429911 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.429879 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:46:02.430109 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.430081 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" podUID="b99ac245-0673-423b-919a-4ac6afda5e2a" containerName="maas-api" containerID="cri-o://0da65b360b2104d7aabfec7081d53d14d8a4a98f78dc62829fa94cdfcc9f66a9" gracePeriod=30 Jul 05 13:46:02.465237 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.465207 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:02.587137 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.587084 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:02.620969 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.620941 2569 generic.go:356] "Generic (PLEG): container finished" podID="b99ac245-0673-423b-919a-4ac6afda5e2a" containerID="0da65b360b2104d7aabfec7081d53d14d8a4a98f78dc62829fa94cdfcc9f66a9" exitCode=0 Jul 05 13:46:02.621114 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.620986 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" event={"ID":"b99ac245-0673-423b-919a-4ac6afda5e2a","Type":"ContainerDied","Data":"0da65b360b2104d7aabfec7081d53d14d8a4a98f78dc62829fa94cdfcc9f66a9"} Jul 05 13:46:02.694432 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.694366 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:46:02.775687 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.775647 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca\") pod \"b99ac245-0673-423b-919a-4ac6afda5e2a\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " Jul 05 13:46:02.775859 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.775697 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52g6f\" (UniqueName: \"kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f\") pod \"b99ac245-0673-423b-919a-4ac6afda5e2a\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " Jul 05 13:46:02.775859 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.775726 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") pod \"b99ac245-0673-423b-919a-4ac6afda5e2a\" (UID: \"b99ac245-0673-423b-919a-4ac6afda5e2a\") " Jul 05 13:46:02.776049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.776019 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b99ac245-0673-423b-919a-4ac6afda5e2a" (UID: "b99ac245-0673-423b-919a-4ac6afda5e2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:46:02.777882 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.777856 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b99ac245-0673-423b-919a-4ac6afda5e2a" (UID: "b99ac245-0673-423b-919a-4ac6afda5e2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:46:02.777980 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.777857 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f" (OuterVolumeSpecName: "kube-api-access-52g6f") pod "b99ac245-0673-423b-919a-4ac6afda5e2a" (UID: "b99ac245-0673-423b-919a-4ac6afda5e2a"). InnerVolumeSpecName "kube-api-access-52g6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:46:02.876786 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.876751 2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b99ac245-0673-423b-919a-4ac6afda5e2a-openshift-service-ca\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:46:02.876786 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.876778 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52g6f\" (UniqueName: \"kubernetes.io/projected/b99ac245-0673-423b-919a-4ac6afda5e2a-kube-api-access-52g6f\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:46:02.876786 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:02.876789 2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b99ac245-0673-423b-919a-4ac6afda5e2a-maas-api-tls\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 13:46:03.628192 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:03.628161 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" Jul 05 13:46:03.628670 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:03.628158 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5" event={"ID":"b99ac245-0673-423b-919a-4ac6afda5e2a","Type":"ContainerDied","Data":"613082c68fa6da0a3410185bea01daca9dcee87093828b880a5f6d87081f98ec"} Jul 05 13:46:03.628670 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:03.628295 2569 scope.go:117] "RemoveContainer" containerID="0da65b360b2104d7aabfec7081d53d14d8a4a98f78dc62829fa94cdfcc9f66a9" Jul 05 13:46:03.651019 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:03.650995 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:46:03.655049 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:03.655030 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-72122384-d7d7b6dc7-4kdf5"] Jul 05 13:46:04.414655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:04.414618 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99ac245-0673-423b-919a-4ac6afda5e2a" path="/var/lib/kubelet/pods/b99ac245-0673-423b-919a-4ac6afda5e2a/volumes" Jul 05 13:46:05.145721 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:05.145681 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:08.630083 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:08.630050 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:08.738825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:08.738786 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:08.870489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:08.870447 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:08.959538 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:08.959508 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:10.169129 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:10.169084 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:10.289376 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:10.289345 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:10.398605 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:10.398570 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:10.645374 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:10.645345 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:11.219926 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:11.219893 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:11.363369 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:11.363338 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:12.155621 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:12.155593 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:15.241685 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:15.241645 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:15.615043 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:15.614969 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:21.510506 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:21.510470 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:21.610968 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:21.610934 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:23.380633 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:23.380597 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:27.479458 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:27.479417 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:27.545768 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:27.545741 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:27.725016 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:27.724983 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:27.815799 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:27.815704 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:29.043261 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:29.043223 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:29.304875 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:29.304783 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:30.075730 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:30.075695 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:30.176463 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:30.176433 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:31.031444 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:31.031377 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:33.491025 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:33.490981 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:33.647339 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:33.647284 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:33.746167 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:33.746080 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:33.829440 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:33.829404 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:35.278652 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:35.278616 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:39.968105 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:39.968071 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:40.071104 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:40.071072 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:40.524448 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:40.524412 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:40.617472 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:40.617444 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:42.079362 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:42.079329 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:49.140544 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:49.140508 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:49.265149 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:49.265113 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:49.454982 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:49.454949 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:49.666366 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:49.666331 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:46:49.953842 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:46:49.953765 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:15.873023 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:15.872992 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:21.718930 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:21.718893 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:21.830250 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:21.830216 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:21.936077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:21.936043 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:37.905636 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:37.905598 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:44.627548 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:44.627513 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:44.752326 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:44.752295 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:44.874946 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:44.874914 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:55.328320 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:55.328288 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:47:56.148346 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:47:56.148313 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:02.023707 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:02.023661 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:02.145501 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:02.145467 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:02.285439 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:02.285340 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:02.400424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:02.400377 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:03.135058 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:03.135026 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:03.233306 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:03.233268 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:03.334947 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:03.334915 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:04.922898 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:04.922860 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:11.052028 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:11.051991 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:11.153225 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:11.153196 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:11.741559 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:11.741529 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:18.162603 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:18.162567 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:18.240451 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:18.240403 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:18.524711 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:18.524636 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:18.943600 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:18.943568 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:19.174111 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:19.174076 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:22.202597 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:22.202514 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:22.397668 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:22.397633 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:22.550203 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:22.550127 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:22.818295 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:22.818215 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:23.211086 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:23.211052 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:23.349178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:23.349148 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:26.507505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:26.507472 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:27.201818 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:27.201778 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:27.291897 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:27.291862 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:27.627743 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:27.627651 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:33.894795 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:33.894757 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:34.000155 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:34.000123 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:34.404242 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:34.404215 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:34.746535 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:34.746441 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:34.858372 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:34.858341 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:41.379354 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:41.379322 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:41.481640 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:41.481607 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:41.661031 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:41.661001 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:41.902925 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:41.902893 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:42.031956 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:42.031877 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:42.132729 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:42.132695 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:42.241755 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:42.241717 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:48.544591 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:48.544558 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:48.657825 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:48.657794 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:48.773691 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:48.773654 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:48.915511 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:48.915480 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:55.419248 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:55.419210 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:48:55.517686 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:48:55.517655 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:02.294937 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:02.294907 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:02.623802 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:02.623714 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:02.874541 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:02.874450 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:05.157983 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:05.157943 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.263935 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.263906 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.368659 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.368626 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.456550 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.456512 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.555430 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.555332 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.899612 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.899580 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:06.997873 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:06.997842 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:07.115047 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:07.115012 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:10.639327 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:10.639234 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:13.454748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:13.454700 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:13.551224 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:13.551183 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:24.338202 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:24.338166 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:27.920075 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:27.920026 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:28.020509 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:28.020473 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:43.230512 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:43.230475 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:43.798726 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:43.798671 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:49.399482 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:49.399447 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:49:54.353788 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:49:54.353712 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:31.521154 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:31.521112 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:32.259616 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:32.259580 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:38.268589 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:38.268554 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:38.368480 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:38.368442 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:38.572634 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:38.572550 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:38.792247 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:38.792216 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:39.876618 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:39.876585 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:39.984312 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:39.984279 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:40.805264 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:40.805226 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:40.893761 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:40.893727 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:42.370499 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:42.370460 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:48.810502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:48.810463 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:48.918222 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:48.918193 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:49.530981 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:49.530949 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:55.780051 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:55.780013 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:55.887023 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:55.886996 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:50:56.020976 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:50:56.020944 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:06.604147 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:06.604110 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:06.980594 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:06.980556 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:27.984258 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:27.984175 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:34.378454 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:34.378425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:34.460870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:34.460831 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:34.800160 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:34.800125 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:35.205398 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:35.205356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:35.626458 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:35.626364 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:37.815497 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:37.815458 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:37.959534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:37.959501 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:38.134861 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:38.134785 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:38.651780 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:38.651745 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:38.754081 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:38.754044 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:42.393033 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:42.392991 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:42.740480 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:42.740373 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:43.038507 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:43.038426 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:43.229054 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:43.229022 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:45.926655 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:45.926618 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:46.028308 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:46.028274 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:46.257811 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:46.257728 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:46.561424 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:46.561330 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:46.790954 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:46.790918 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:46.900130 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:46.900099 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:50.419350 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:50.419312 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:59.382082 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:59.382050 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:51:59.483740 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:51:59.483708 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:52:07.544689 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:52:07.544657 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:52:07.640772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:52:07.640741 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:52:19.787096 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:52:19.787056 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:52:39.363933 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:52:39.363901 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:52:59.732007 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:52:59.731935 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:00.727474 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:00.727439 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:00.904098 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:00.904066 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:01.285489 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:01.285456 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:01.394535 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:01.394499 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:01.495772 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:01.495740 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:01.648690 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:01.648658 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:06.170111 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:06.170076 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:06.369876 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:06.369840 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:37.399695 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:37.399661 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:43.115292 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:43.115253 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:43.385243 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:43.385165 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:43.668993 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:43.668960 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:43.909983 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:43.909948 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:44.280350 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:44.280313 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:44.380644 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:44.380597 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:44.484473 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:44.484435 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:44.636541 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:44.636465 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:50.366571 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:50.366530 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:50.472701 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:50.472669 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:50.648035 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:50.648002 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:50.881891 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:50.881858 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:51.236003 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:51.235974 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:51.581030 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:51.580947 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:51.741505 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:51.741468 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:54.492218 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:54.492185 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:54.590101 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:54.590065 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:54.694097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:54.694065 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:55.036502 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:55.036471 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:55.139097 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:55.139050 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:58.980684 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:58.980648 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:59.461006 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:59.460979 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:59.766692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:59.766600 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:53:59.965807 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:53:59.965769 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:02.615072 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:02.615035 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:02.695132 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:02.695103 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:02.764456 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:02.764419 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:02.865849 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:02.865760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:03.253648 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:03.253585 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:03.353003 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:03.352969 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:07.006073 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:07.006040 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:14.304962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:14.304925 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:14.413922 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:14.413890 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:15.135356 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:15.135305 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:15.529368 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:15.529336 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:15.629275 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:15.629245 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:15.729524 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:15.729494 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:15.825994 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:15.825914 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:21.272599 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:21.272503 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:21.373915 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:21.373873 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:21.554999 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:21.554923 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:21.890487 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:21.890397 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:22.156081 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:22.156055 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:22.486534 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:22.486443 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:22.630095 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:22.630067 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:22.733178 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:22.733141 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:22.900031 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:22.900005 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:28.341922 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:28.341882 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:28.404275 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:28.404235 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:28.624309 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:28.624218 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:28.865867 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:28.865834 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:29.200814 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:29.200768 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:29.519870 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:29.519793 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:29.828043 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:29.827963 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:32.639214 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:32.639175 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:32.732442 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:32.732396 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:32.813620 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:32.813587 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:32.929277 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:32.929249 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:33.216968 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:33.216883 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:33.321864 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:33.321828 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:37.171895 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:37.171864 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:37.552100 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:37.552013 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:37.874019 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:37.873935 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:38.344752 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:38.344702 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:40.730618 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:40.730583 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:40.817969 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:40.817937 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:40.893884 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:40.893852 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:41.163544 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:41.163513 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:41.417962 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:41.417877 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:41.519047 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:41.519017 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:45.247978 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:45.247939 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:53.999794 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:53.999760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:54.101821 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:54.101787 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:54:54.428702 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:54:54.428668 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:02.113519 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:02.113482 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:02.210696 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:02.210658 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:31.274160 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:31.274125 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:35.326201 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:35.326167 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:53.059010 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:53.058928 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:55:53.156092 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:55:53.156061 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:56:21.901692 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:56:21.901655 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:56:21.965077 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:56:21.965042 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:57:27.433020 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:57:27.432941 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:57:28.738943 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:57:28.738910 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:57:39.535656 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:57:39.535606 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:58:35.350225 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:58:35.350192 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:14.999341 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:14.999249 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:15.099289 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:15.099253 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:20.809336 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:20.809300 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:21.768117 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:21.768078 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:21.925027 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:21.924984 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:21.992222 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:21.992197 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:30.931397 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:30.931352 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:46.947748 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:46.947710 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:54.718220 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:54.718185 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:54.819847 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:54.819822 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 13:59:57.623159 ip-10-0-128-53 kubenswrapper[2569]: I0705 13:59:57.623119 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:00.176930 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.176892 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2"] Jul 05 14:00:00.177582 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.177560 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99ac245-0673-423b-919a-4ac6afda5e2a" containerName="maas-api" Jul 05 14:00:00.177692 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.177584 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99ac245-0673-423b-919a-4ac6afda5e2a" containerName="maas-api" Jul 05 14:00:00.177692 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.177686 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99ac245-0673-423b-919a-4ac6afda5e2a" containerName="maas-api" Jul 05 14:00:00.181037 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.181000 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:00.182088 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.182068 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j"] Jul 05 14:00:00.186210 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.186193 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-v79lf"] Jul 05 14:00:00.186317 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.186297 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:00.189758 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.189741 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:00.227226 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.227191 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-v79lf"] Jul 05 14:00:00.229793 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.229761 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j"] Jul 05 14:00:00.231707 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.231682 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2"] Jul 05 14:00:00.306152 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.306116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh9v6\" (UniqueName: \"kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6\") pod \"maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2\" (UID: \"1840ed8b-f6d8-436f-9672-cf830bfbcfe3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:00.306319 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.306168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bb2g\" (UniqueName: \"kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g\") pod \"maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j\" (UID: \"eac9c482-10bf-43b4-85dc-7e82abf8d2d7\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:00.306319 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.306200 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkz2\" (UniqueName: \"kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2\") pod \"maas-api-key-cleanup-29721000-v79lf\" (UID: \"219a907b-8daa-4c7c-8b94-90c0f09d2dc0\") " pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:00.407462 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.407424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh9v6\" (UniqueName: \"kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6\") pod \"maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2\" (UID: \"1840ed8b-f6d8-436f-9672-cf830bfbcfe3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:00.407462 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.407470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bb2g\" (UniqueName: \"kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g\") pod \"maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j\" (UID: \"eac9c482-10bf-43b4-85dc-7e82abf8d2d7\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:00.407671 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.407507 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkz2\" (UniqueName: \"kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2\") pod \"maas-api-key-cleanup-29721000-v79lf\" (UID: \"219a907b-8daa-4c7c-8b94-90c0f09d2dc0\") " pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:00.416607 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.416573 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bb2g\" (UniqueName: \"kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g\") pod \"maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j\" (UID: \"eac9c482-10bf-43b4-85dc-7e82abf8d2d7\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:00.416764 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.416612 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh9v6\" (UniqueName: \"kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6\") pod \"maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2\" (UID: \"1840ed8b-f6d8-436f-9672-cf830bfbcfe3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:00.416764 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.416676 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkz2\" (UniqueName: \"kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2\") pod \"maas-api-key-cleanup-29721000-v79lf\" (UID: \"219a907b-8daa-4c7c-8b94-90c0f09d2dc0\") " pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:00.493224 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.493145 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:00.500272 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.500254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:00.507607 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.507569 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:00.661611 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.661576 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j"] Jul 05 14:00:00.664712 ip-10-0-128-53 kubenswrapper[2569]: W0705 14:00:00.664640 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac9c482_10bf_43b4_85dc_7e82abf8d2d7.slice/crio-a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80 WatchSource:0}: Error finding container a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80: Status 404 returned error can't find the container with id a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80 Jul 05 14:00:00.715066 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.715042 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-v79lf"] Jul 05 14:00:00.717446 ip-10-0-128-53 kubenswrapper[2569]: W0705 14:00:00.717414 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219a907b_8daa_4c7c_8b94_90c0f09d2dc0.slice/crio-16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185 WatchSource:0}: Error finding container 16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185: Status 404 returned error can't find the container with id 16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185 Jul 05 14:00:00.890253 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:00.890227 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2"] Jul 05 14:00:00.891565 ip-10-0-128-53 kubenswrapper[2569]: W0705 14:00:00.891539 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1840ed8b_f6d8_436f_9672_cf830bfbcfe3.slice/crio-bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f WatchSource:0}: Error finding container bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f: Status 404 returned error can't find the container with id bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f Jul 05 14:00:01.027698 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:01.027601 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" event={"ID":"eac9c482-10bf-43b4-85dc-7e82abf8d2d7","Type":"ContainerStarted","Data":"379737fc58b7828df9f3eba4077f252cab0068a8b760cd7e3c88c249ad127e8f"} Jul 05 14:00:01.027698 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:01.027658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" event={"ID":"eac9c482-10bf-43b4-85dc-7e82abf8d2d7","Type":"ContainerStarted","Data":"a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80"} Jul 05 14:00:01.028842 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:01.028817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" event={"ID":"219a907b-8daa-4c7c-8b94-90c0f09d2dc0","Type":"ContainerStarted","Data":"16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185"} Jul 05 14:00:01.029945 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:01.029926 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" event={"ID":"1840ed8b-f6d8-436f-9672-cf830bfbcfe3","Type":"ContainerStarted","Data":"bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f"} Jul 05 14:00:01.044488 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:01.044445 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" podStartSLOduration=1.044430122 podStartE2EDuration="1.044430122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:00:01.042662795 +0000 UTC m=+2493.123578203" watchObservedRunningTime="2026-07-05 14:00:01.044430122 +0000 UTC m=+2493.125345506" Jul 05 14:00:02.036957 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.036862 2569 generic.go:356] "Generic (PLEG): container finished" podID="eac9c482-10bf-43b4-85dc-7e82abf8d2d7" containerID="379737fc58b7828df9f3eba4077f252cab0068a8b760cd7e3c88c249ad127e8f" exitCode=0 Jul 05 14:00:02.037439 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.036944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" event={"ID":"eac9c482-10bf-43b4-85dc-7e82abf8d2d7","Type":"ContainerDied","Data":"379737fc58b7828df9f3eba4077f252cab0068a8b760cd7e3c88c249ad127e8f"} Jul 05 14:00:02.038849 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.038825 2569 generic.go:356] "Generic (PLEG): container finished" podID="219a907b-8daa-4c7c-8b94-90c0f09d2dc0" containerID="a4305168b59be01773aeede30ca9c912e260274a4495b1aac8d6aa55d9bc77ae" exitCode=0 Jul 05 14:00:02.038983 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.038911 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" event={"ID":"219a907b-8daa-4c7c-8b94-90c0f09d2dc0","Type":"ContainerDied","Data":"a4305168b59be01773aeede30ca9c912e260274a4495b1aac8d6aa55d9bc77ae"} Jul 05 14:00:02.041597 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.041570 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" event={"ID":"1840ed8b-f6d8-436f-9672-cf830bfbcfe3","Type":"ContainerStarted","Data":"980f588c17556f3b61918a8eb62515a4d5efe5a34c145256babc8105bdef38bf"} Jul 05 14:00:02.087979 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.087932 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" podStartSLOduration=2.087916287 podStartE2EDuration="2.087916287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:00:02.087335579 +0000 UTC m=+2494.168250956" watchObservedRunningTime="2026-07-05 14:00:02.087916287 +0000 UTC m=+2494.168831672" Jul 05 14:00:02.829801 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.829761 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:02.930151 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:02.930119 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:03.049480 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.049444 2569 generic.go:356] "Generic (PLEG): container finished" podID="1840ed8b-f6d8-436f-9672-cf830bfbcfe3" containerID="980f588c17556f3b61918a8eb62515a4d5efe5a34c145256babc8105bdef38bf" exitCode=0 Jul 05 14:00:03.049901 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.049508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" event={"ID":"1840ed8b-f6d8-436f-9672-cf830bfbcfe3","Type":"ContainerDied","Data":"980f588c17556f3b61918a8eb62515a4d5efe5a34c145256babc8105bdef38bf"} Jul 05 14:00:03.197823 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.197791 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:03.230856 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.230826 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:03.231028 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.230891 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvkz2\" (UniqueName: \"kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2\") pod \"219a907b-8daa-4c7c-8b94-90c0f09d2dc0\" (UID: \"219a907b-8daa-4c7c-8b94-90c0f09d2dc0\") " Jul 05 14:00:03.232870 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.232839 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2" (OuterVolumeSpecName: "kube-api-access-cvkz2") pod "219a907b-8daa-4c7c-8b94-90c0f09d2dc0" (UID: "219a907b-8daa-4c7c-8b94-90c0f09d2dc0"). InnerVolumeSpecName "kube-api-access-cvkz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 14:00:03.331725 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.331693 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bb2g\" (UniqueName: \"kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g\") pod \"eac9c482-10bf-43b4-85dc-7e82abf8d2d7\" (UID: \"eac9c482-10bf-43b4-85dc-7e82abf8d2d7\") " Jul 05 14:00:03.331953 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.331940 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvkz2\" (UniqueName: \"kubernetes.io/projected/219a907b-8daa-4c7c-8b94-90c0f09d2dc0-kube-api-access-cvkz2\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 14:00:03.333705 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.333675 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g" (OuterVolumeSpecName: "kube-api-access-5bb2g") pod "eac9c482-10bf-43b4-85dc-7e82abf8d2d7" (UID: "eac9c482-10bf-43b4-85dc-7e82abf8d2d7"). InnerVolumeSpecName "kube-api-access-5bb2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 14:00:03.432712 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:03.432668 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bb2g\" (UniqueName: \"kubernetes.io/projected/eac9c482-10bf-43b4-85dc-7e82abf8d2d7-kube-api-access-5bb2g\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 14:00:04.059318 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.059291 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" Jul 05 14:00:04.059318 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.059301 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j" event={"ID":"eac9c482-10bf-43b4-85dc-7e82abf8d2d7","Type":"ContainerDied","Data":"a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80"} Jul 05 14:00:04.059815 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.059350 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1250b5b778efa9b420c325d7114def4e95de6f08670d672a5d569684cbd6b80" Jul 05 14:00:04.060664 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.060645 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" Jul 05 14:00:04.060664 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.060657 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-v79lf" event={"ID":"219a907b-8daa-4c7c-8b94-90c0f09d2dc0","Type":"ContainerDied","Data":"16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185"} Jul 05 14:00:04.060865 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.060695 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16d6d9360c3b2460cb24ff126612e36f0a07e79a1db9c9aa726b8bed3019c185" Jul 05 14:00:04.210337 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.210309 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:04.250822 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.250792 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh9v6\" (UniqueName: \"kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6\") pod \"1840ed8b-f6d8-436f-9672-cf830bfbcfe3\" (UID: \"1840ed8b-f6d8-436f-9672-cf830bfbcfe3\") " Jul 05 14:00:04.252811 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.252781 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6" (OuterVolumeSpecName: "kube-api-access-qh9v6") pod "1840ed8b-f6d8-436f-9672-cf830bfbcfe3" (UID: "1840ed8b-f6d8-436f-9672-cf830bfbcfe3"). InnerVolumeSpecName "kube-api-access-qh9v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 14:00:04.351686 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:04.351594 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh9v6\" (UniqueName: \"kubernetes.io/projected/1840ed8b-f6d8-436f-9672-cf830bfbcfe3-kube-api-access-qh9v6\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\"" Jul 05 14:00:05.067718 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:05.067674 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" event={"ID":"1840ed8b-f6d8-436f-9672-cf830bfbcfe3","Type":"ContainerDied","Data":"bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f"} Jul 05 14:00:05.068102 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:05.067733 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bea4441bb4d93b34e35dc539d9bd27045baac4280d56c32ca59d1aa84c492f2f" Jul 05 14:00:05.068102 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:05.067695 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2" Jul 05 14:00:40.509031 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:40.508993 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:41.515689 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:41.515656 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:42.595227 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:42.595184 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:43.003298 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:43.003265 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:43.103658 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:43.103618 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:43.240881 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:43.240846 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j"] Jul 05 14:00:43.244425 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:43.244359 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c2f889-29721000-4kn4j"] Jul 05 14:00:43.244597 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:43.244577 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:00:44.415557 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:44.415524 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac9c482-10bf-43b4-85dc-7e82abf8d2d7" path="/var/lib/kubelet/pods/eac9c482-10bf-43b4-85dc-7e82abf8d2d7/volumes" Jul 05 14:00:48.078490 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:00:48.078451 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:25.332034 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:25.331998 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:25.643649 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:25.643618 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:25.871902 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:25.871869 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:26.047198 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.047107 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:26.457178 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.457147 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:26.557982 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.557951 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:26.722525 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.722439 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2"] Jul 05 14:01:26.723743 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.723714 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:26.724786 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:26.724766 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-7acb12-29721000-lrhk2"] Jul 05 14:01:28.415899 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:28.415869 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1840ed8b-f6d8-436f-9672-cf830bfbcfe3" path="/var/lib/kubelet/pods/1840ed8b-f6d8-436f-9672-cf830bfbcfe3/volumes" Jul 05 14:01:32.393186 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:32.393138 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:32.456217 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:32.456179 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:32.649111 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:32.649034 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:32.875537 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:32.875501 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:38.018172 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.018145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-chk4r_dd2a5391-6053-4048-b48f-e74250980672/manager/0.log" Jul 05 14:01:38.133278 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.133249 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-945pb_96c2f716-a13a-4de4-98fc-f7fbfde0b277/manager/0.log" Jul 05 14:01:38.250357 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.250327 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85484b5f99-bzxvh_e36c8910-e8c8-436c-8182-7bcaa7eced44/maas-api/0.log" Jul 05 14:01:38.357341 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.357275 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720970-jgbx8_41663662-71c5-4c7f-850b-87479962c0a7/cleanup/0.log" Jul 05 14:01:38.590602 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.590575 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721000-v79lf_219a907b-8daa-4c7c-8b94-90c0f09d2dc0/cleanup/0.log" Jul 05 14:01:38.704623 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.704594 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7497d7ff7b-ntbmm_fd43a46b-99d4-4cc7-9d1d-2dc816fa994e/manager/0.log" Jul 05 14:01:38.813910 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.813884 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xcmlq_b6be8445-83d4-464f-b389-688798b46c99/server/0.log" Jul 05 14:01:38.934736 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:38.934695 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-shgls_9026ed1d-c5dc-490d-b9e2-d03304910068/manager/0.log" Jul 05 14:01:39.181191 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:39.181165 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-jbvmq_6a20452e-cf1f-4f4a-b016-cd2b390aeb66/copy-manifests/0.log" Jul 05 14:01:39.187112 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:39.187093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-jbvmq_6a20452e-cf1f-4f4a-b016-cd2b390aeb66/manager/0.log" Jul 05 14:01:40.827896 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:40.827866 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xqlj6_ec62d6f0-541e-47a5-b8cf-6e827a7124b4/manager/0.log" Jul 05 14:01:40.939520 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:40.939493 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2snx_e97e4fa2-9cab-4a21-90ea-53fb7e271723/manager/0.log" Jul 05 14:01:41.049946 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:41.049919 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ftgg5_14056ad7-d1bf-4e25-b7db-7dc35fc97376/kuadrant-console-plugin/0.log" Jul 05 14:01:41.165281 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:41.165251 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q4m2z_04bf4f81-5c97-476e-b124-b686e14fe346/registry-server/0.log" Jul 05 14:01:41.289835 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:41.289805 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6xqdt_58772690-61a6-4f45-af1c-22e31079487d/manager/0.log" Jul 05 14:01:41.543529 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:41.543457 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ssrwc_13960c6c-3284-4bf6-a168-38202524d5de/manager/0.log" Jul 05 14:01:42.233901 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:42.233871 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-xzh77_0da033f1-acc6-48fe-b5a4-ac65b56e5629/kube-auth-proxy/0.log" Jul 05 14:01:42.464519 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:42.464491 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2p8w_7dbd752a-a403-42c8-bfe6-c870477bbdd5/payload-pre-processing/0.log" Jul 05 14:01:42.583232 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:42.583165 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mcppm_1d5bf3aa-766d-4e4d-8994-e603de20e516/payload-processing/0.log" Jul 05 14:01:42.695040 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:42.695017 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6675b69f-2vscq_669c8f24-bdb5-4579-8b26-c0c071070684/router/0.log" Jul 05 14:01:43.025809 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:43.025782 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9tqfc_c5981e21-94a9-4e80-bc6b-9660ad46fb4f/main/0.log" Jul 05 14:01:43.135127 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:43.135100 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-c5gtc_dd2b6ca6-2d20-4e71-afba-90dc64f7ccf1/main/0.log" Jul 05 14:01:43.360229 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:43.360154 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbswlhc_5ccbe8ff-e3e4-457f-bd0f-26a5afd53548/main/0.log" Jul 05 14:01:48.021653 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:48.021618 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:48.120698 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:48.120665 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" limit=1024 Jul 05 14:01:50.820093 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:50.820022 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bhr8d_7b657fe4-b60c-4298-b201-3a6d10bb345b/global-pull-secret-syncer/0.log" Jul 05 14:01:50.966954 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:50.966920 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6hlfp_6e637ff0-ca63-40ef-b4cf-4dc07ade5c6a/konnectivity-agent/0.log" Jul 05 14:01:51.086910 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:51.086834 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-53.ec2.internal_6da60c6aa145a773b0c59de51f12d9f6/haproxy/0.log" Jul 05 14:01:56.371365 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.371285 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xqlj6_ec62d6f0-541e-47a5-b8cf-6e827a7124b4/manager/0.log" Jul 05 14:01:56.401997 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.401975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2snx_e97e4fa2-9cab-4a21-90ea-53fb7e271723/manager/0.log" Jul 05 14:01:56.427765 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.427745 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ftgg5_14056ad7-d1bf-4e25-b7db-7dc35fc97376/kuadrant-console-plugin/0.log" Jul 05 14:01:56.465021 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.465005 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q4m2z_04bf4f81-5c97-476e-b124-b686e14fe346/registry-server/0.log" Jul 05 14:01:56.615517 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.615487 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6xqdt_58772690-61a6-4f45-af1c-22e31079487d/manager/0.log" Jul 05 14:01:56.725167 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:56.725137 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ssrwc_13960c6c-3284-4bf6-a168-38202524d5de/manager/0.log" Jul 05 14:01:58.199034 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.198998 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/alertmanager/0.log" Jul 05 14:01:58.224241 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.224219 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/config-reloader/0.log" Jul 05 14:01:58.246341 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.246317 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/kube-rbac-proxy-web/0.log" Jul 05 14:01:58.271185 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.271167 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/kube-rbac-proxy/0.log" Jul 05 14:01:58.297484 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.297463 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/kube-rbac-proxy-metric/0.log" Jul 05 14:01:58.323377 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.323359 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/prom-label-proxy/0.log" Jul 05 14:01:58.346856 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.346836 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7dd8a8ac-e5fc-4f25-8d88-17dee0df93af/init-config-reloader/0.log" Jul 05 14:01:58.797874 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.797847 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxb6t_0eb81c05-5065-4029-9507-a5cc1db357fe/node-exporter/0.log" Jul 05 14:01:58.832113 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.832090 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxb6t_0eb81c05-5065-4029-9507-a5cc1db357fe/kube-rbac-proxy/0.log" Jul 05 14:01:58.861475 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:58.861454 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxb6t_0eb81c05-5065-4029-9507-a5cc1db357fe/init-textfile/0.log" Jul 05 14:01:59.175530 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.175502 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-q2clm_181119b3-2918-47d2-aa63-8f61c78d15a7/prometheus-operator/0.log" Jul 05 14:01:59.199132 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.199103 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-q2clm_181119b3-2918-47d2-aa63-8f61c78d15a7/kube-rbac-proxy/0.log" Jul 05 14:01:59.224556 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.224530 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-rxrh6_39a99df3-b829-42a0-b772-d1ca5be93f44/prometheus-operator-admission-webhook/0.log" Jul 05 14:01:59.261147 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.261125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbb9674d-t9j9k_428dbac2-b810-42ba-ac4d-92c4566da9b8/telemeter-client/0.log" Jul 05 14:01:59.285184 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.285156 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbb9674d-t9j9k_428dbac2-b810-42ba-ac4d-92c4566da9b8/reload/0.log" Jul 05 14:01:59.308222 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.308201 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbb9674d-t9j9k_428dbac2-b810-42ba-ac4d-92c4566da9b8/kube-rbac-proxy/0.log" Jul 05 14:01:59.345178 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.345154 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/thanos-query/0.log" Jul 05 14:01:59.367531 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.367508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/kube-rbac-proxy-web/0.log" Jul 05 14:01:59.392526 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.392508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/kube-rbac-proxy/0.log" Jul 05 14:01:59.414554 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.414534 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/prom-label-proxy/0.log" Jul 05 14:01:59.441112 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.441093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/kube-rbac-proxy-rules/0.log" Jul 05 14:01:59.469673 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:01:59.469654 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-659c654ccc-njdst_a4b85918-cd3d-43a9-afd9-734f9157167f/kube-rbac-proxy-metrics/0.log" Jul 05 14:02:01.973811 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.973776 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd"] Jul 05 14:02:01.974249 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974234 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="219a907b-8daa-4c7c-8b94-90c0f09d2dc0" containerName="cleanup" Jul 05 14:02:01.974249 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974248 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="219a907b-8daa-4c7c-8b94-90c0f09d2dc0" containerName="cleanup" Jul 05 14:02:01.974343 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974265 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac9c482-10bf-43b4-85dc-7e82abf8d2d7" containerName="cleanup" Jul 05 14:02:01.974343 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974270 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac9c482-10bf-43b4-85dc-7e82abf8d2d7" containerName="cleanup" Jul 05 14:02:01.974343 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974283 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1840ed8b-f6d8-436f-9672-cf830bfbcfe3" containerName="cleanup" Jul 05 14:02:01.974343 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974296 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1840ed8b-f6d8-436f-9672-cf830bfbcfe3" containerName="cleanup" Jul 05 14:02:01.974525 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974364 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="219a907b-8daa-4c7c-8b94-90c0f09d2dc0" containerName="cleanup" Jul 05 14:02:01.974525 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974370 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1840ed8b-f6d8-436f-9672-cf830bfbcfe3" containerName="cleanup" Jul 05 14:02:01.974525 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.974378 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac9c482-10bf-43b4-85dc-7e82abf8d2d7" containerName="cleanup" Jul 05 14:02:01.977822 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.977803 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:01.980588 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.980566 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srwzm\"/\"openshift-service-ca.crt\"" Jul 05 14:02:01.980678 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.980594 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srwzm\"/\"kube-root-ca.crt\"" Jul 05 14:02:01.981673 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.981659 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srwzm\"/\"default-dockercfg-hwlnw\"" Jul 05 14:02:01.986702 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:01.986682 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd"] Jul 05 14:02:02.013230 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.013199 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-826t4_bf491e3b-6725-493f-895d-384c2fb23ef7/download-server/0.log" Jul 05 14:02:02.098971 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.098932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9ft\" (UniqueName: \"kubernetes.io/projected/6644ae90-4d99-4544-9fcc-114c3f0a4da2-kube-api-access-qk9ft\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.098971 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.098977 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-lib-modules\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.099202 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.098999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-sys\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.099202 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.099061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-podres\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.099202 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.099155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-proc\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200196 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-lib-modules\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200196 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-sys\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200224 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-podres\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200263 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-proc\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200305 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-sys\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9ft\" (UniqueName: \"kubernetes.io/projected/6644ae90-4d99-4544-9fcc-114c3f0a4da2-kube-api-access-qk9ft\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200353 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-lib-modules\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-proc\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.200434 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.200424 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6644ae90-4d99-4544-9fcc-114c3f0a4da2-podres\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.208357 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.208330 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9ft\" (UniqueName: \"kubernetes.io/projected/6644ae90-4d99-4544-9fcc-114c3f0a4da2-kube-api-access-qk9ft\") pod \"perf-node-gather-daemonset-9pcjd\" (UID: \"6644ae90-4d99-4544-9fcc-114c3f0a4da2\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.288889 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.288809 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.425271 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.425246 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd"] Jul 05 14:02:02.427342 ip-10-0-128-53 kubenswrapper[2569]: W0705 14:02:02.427310 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6644ae90_4d99_4544_9fcc_114c3f0a4da2.slice/crio-7b2f958048b7c34bc8aecb34e609c064549bdbff346c8fa1068eac59d1efce35 WatchSource:0}: Error finding container 7b2f958048b7c34bc8aecb34e609c064549bdbff346c8fa1068eac59d1efce35: Status 404 returned error can't find the container with id 7b2f958048b7c34bc8aecb34e609c064549bdbff346c8fa1068eac59d1efce35 Jul 05 14:02:02.685638 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.685601 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-62slj_3c18daa4-755b-4939-891a-192f08c6a624/volume-data-source-validator/0.log" Jul 05 14:02:02.698672 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.698632 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" event={"ID":"6644ae90-4d99-4544-9fcc-114c3f0a4da2","Type":"ContainerStarted","Data":"65421a158fcbfcd6b1e8ad2590e2f99fcc1ff05dd4e0da6650d9e6694f7796bb"} Jul 05 14:02:02.698832 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.698693 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" event={"ID":"6644ae90-4d99-4544-9fcc-114c3f0a4da2","Type":"ContainerStarted","Data":"7b2f958048b7c34bc8aecb34e609c064549bdbff346c8fa1068eac59d1efce35"} Jul 05 14:02:02.698832 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.698767 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:02.715014 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:02.714955 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" podStartSLOduration=1.714937301 podStartE2EDuration="1.714937301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:02:02.714340209 +0000 UTC m=+2614.795255607" watchObservedRunningTime="2026-07-05 14:02:02.714937301 +0000 UTC m=+2614.795852719" Jul 05 14:02:03.741331 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:03.741301 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8b584_a78522ad-9741-4a1e-9490-6722105f8d70/dns/0.log" Jul 05 14:02:03.765203 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:03.765169 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8b584_a78522ad-9741-4a1e-9490-6722105f8d70/kube-rbac-proxy/0.log" Jul 05 14:02:03.922108 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:03.922082 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkf7k_cb639378-efc6-4433-b34e-700b3bf58d6b/dns-node-resolver/0.log" Jul 05 14:02:04.504777 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:04.504745 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7689fffb6-drf2d_415dee26-48bf-40c3-9bb0-9ee5a49db7ab/registry/0.log" Jul 05 14:02:04.528674 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:04.528648 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f8hhr_86065ff3-869e-4ac7-be22-99c66b70f51a/node-ca/0.log" Jul 05 14:02:05.773236 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:05.773203 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-xzh77_0da033f1-acc6-48fe-b5a4-ac65b56e5629/kube-auth-proxy/0.log" Jul 05 14:02:05.893817 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:05.893779 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2p8w_7dbd752a-a403-42c8-bfe6-c870477bbdd5/payload-pre-processing/0.log" Jul 05 14:02:05.941581 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:05.941550 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mcppm_1d5bf3aa-766d-4e4d-8994-e603de20e516/payload-processing/0.log" Jul 05 14:02:05.964702 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:05.964680 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6675b69f-2vscq_669c8f24-bdb5-4579-8b26-c0c071070684/router/0.log" Jul 05 14:02:06.692711 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:06.692678 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsn9p_09ccf996-d4b7-4492-9c19-2e368be34501/serve-healthcheck-canary/0.log" Jul 05 14:02:07.357802 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:07.357773 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6rd_b17aedc2-4300-4910-8848-fb44c750e94f/kube-rbac-proxy/0.log" Jul 05 14:02:07.383645 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:07.383623 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6rd_b17aedc2-4300-4910-8848-fb44c750e94f/exporter/0.log" Jul 05 14:02:07.406123 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:07.406105 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6rd_b17aedc2-4300-4910-8848-fb44c750e94f/extractor/0.log" Jul 05 14:02:08.714138 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:08.714111 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-9pcjd" Jul 05 14:02:09.661782 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:09.661761 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-chk4r_dd2a5391-6053-4048-b48f-e74250980672/manager/0.log" Jul 05 14:02:09.801989 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:09.801903 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-945pb_96c2f716-a13a-4de4-98fc-f7fbfde0b277/manager/0.log" Jul 05 14:02:09.840021 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:09.839994 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85484b5f99-bzxvh_e36c8910-e8c8-436c-8182-7bcaa7eced44/maas-api/0.log" Jul 05 14:02:09.866005 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:09.865980 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720970-jgbx8_41663662-71c5-4c7f-850b-87479962c0a7/cleanup/0.log" Jul 05 14:02:09.931436 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:09.931414 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721000-v79lf_219a907b-8daa-4c7c-8b94-90c0f09d2dc0/cleanup/0.log" Jul 05 14:02:10.034602 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:10.034562 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7497d7ff7b-ntbmm_fd43a46b-99d4-4cc7-9d1d-2dc816fa994e/manager/0.log" Jul 05 14:02:10.057146 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:10.057083 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xcmlq_b6be8445-83d4-464f-b389-688798b46c99/server/0.log" Jul 05 14:02:10.128974 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:10.128948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-shgls_9026ed1d-c5dc-490d-b9e2-d03304910068/manager/0.log" Jul 05 14:02:10.272513 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:10.272480 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-jbvmq_6a20452e-cf1f-4f4a-b016-cd2b390aeb66/manager/0.log" Jul 05 14:02:10.296468 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:10.296446 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-jbvmq_6a20452e-cf1f-4f4a-b016-cd2b390aeb66/copy-manifests/0.log" Jul 05 14:02:12.804427 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:12.804374 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-xzh77_0da033f1-acc6-48fe-b5a4-ac65b56e5629/kube-auth-proxy/0.log" Jul 05 14:02:12.909623 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:12.909590 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2p8w_7dbd752a-a403-42c8-bfe6-c870477bbdd5/payload-pre-processing/0.log" Jul 05 14:02:12.945098 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:12.945071 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mcppm_1d5bf3aa-766d-4e4d-8994-e603de20e516/payload-processing/0.log" Jul 05 14:02:12.959754 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:12.959720 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6675b69f-2vscq_669c8f24-bdb5-4579-8b26-c0c071070684/router/0.log" Jul 05 14:02:14.344324 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:14.344280 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-xzh77_0da033f1-acc6-48fe-b5a4-ac65b56e5629/kube-auth-proxy/0.log" Jul 05 14:02:14.452854 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:14.452828 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2p8w_7dbd752a-a403-42c8-bfe6-c870477bbdd5/payload-pre-processing/0.log" Jul 05 14:02:14.499210 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:14.499182 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mcppm_1d5bf3aa-766d-4e4d-8994-e603de20e516/payload-processing/0.log" Jul 05 14:02:14.517193 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:14.517172 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6675b69f-2vscq_669c8f24-bdb5-4579-8b26-c0c071070684/router/0.log" Jul 05 14:02:17.017960 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:17.017885 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-cwrct_cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad/migrator/0.log" Jul 05 14:02:17.057128 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:17.057102 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-cwrct_cb32c60d-0ff5-4ed4-a331-77ac3be0a1ad/graceful-termination/0.log" Jul 05 14:02:18.475818 ip-10-0-128-53 kubenswrapper[2569]: I0705 14:02:18.475791 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8zk6j_6fbfa86c-c677-4091-901f-c936a865545b/kube-multus/0.log"