Jul 09 21:51:08.767535 ip-10-0-133-173 systemd[1]: Starting Kubernetes Kubelet... Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 21:51:09.132784 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.128851 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133708 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133720 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133724 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133727 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133729 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133732 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133735 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133737 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133740 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133742 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133745 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133747 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133750 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133752 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133754 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133757 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133766 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133769 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133771 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.208744 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133774 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.196610 ip-10-0-133-173 systemd[1]: Started Kubernetes Kubelet. Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133776 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133779 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133781 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133784 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133786 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133789 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133791 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133794 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133796 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133799 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133802 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133804 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133807 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133809 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133812 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133815 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133817 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133819 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.241519 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133822 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133824 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133827 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133830 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133833 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133835 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133838 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133841 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133845 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133848 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133850 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133853 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133855 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133858 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133860 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133863 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133865 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133868 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.464276 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133870 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133873 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133875 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133878 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133880 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133882 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133885 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133887 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133890 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133899 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133905 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133909 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133914 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133917 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133922 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133926 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133930 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133934 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133937 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.475345 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133940 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133943 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133947 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133951 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133954 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133956 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133960 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133962 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133965 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133968 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133971 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133973 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133976 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133979 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133982 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133984 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133987 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133990 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133992 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133995 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.476123 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133997 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.133999 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.134002 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136114 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136121 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136125 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136128 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136133 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136137 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136140 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136143 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136147 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136151 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136154 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136157 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136160 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136162 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136165 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136167 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.476789 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136170 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136173 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136175 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136178 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136180 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136183 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136186 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136189 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136191 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136194 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136196 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136199 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136202 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136204 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136207 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136209 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136212 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136215 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136217 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.477364 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136220 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136222 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136225 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136229 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136232 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136234 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136237 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136239 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136242 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136244 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136247 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136249 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136252 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136255 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136257 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136260 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136263 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136265 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136268 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136270 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.477950 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136273 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136276 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136278 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136280 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136283 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136286 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136289 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136291 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136294 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136296 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136299 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136301 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136303 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136306 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136308 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136330 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136333 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136336 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136339 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.478555 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136342 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136345 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136347 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136350 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136353 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136358 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136361 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136364 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136367 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136370 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136373 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136375 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136378 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136381 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136384 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136386 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136389 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136392 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136394 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136396 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.479121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136399 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136401 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136404 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136406 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136408 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136770 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136775 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136778 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136782 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136785 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136788 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136791 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136794 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136797 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136799 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136802 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136804 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136808 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136810 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136813 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.479716 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136815 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136818 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136820 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136823 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136825 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136829 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136832 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136835 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136838 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136840 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136843 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136845 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136848 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136850 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136853 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136855 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136859 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136863 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136866 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.480335 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136868 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136872 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136875 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136878 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136881 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136884 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136886 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136889 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136893 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136896 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136901 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136903 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136906 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136908 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136911 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136913 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136915 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136917 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136920 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136922 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.480865 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136925 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136927 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136930 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136932 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136935 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136937 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136939 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136942 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136944 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136946 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136949 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136951 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136953 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136957 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136960 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136962 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136965 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136967 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136970 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136972 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.481416 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136974 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136977 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136981 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136983 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136985 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136988 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136990 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136993 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136996 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.136998 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137000 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137003 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137005 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137008 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137010 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137013 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137015 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137018 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137020 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137022 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.481919 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137025 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137027 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137029 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137032 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137034 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137100 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137106 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137112 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137116 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137123 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137127 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137133 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137139 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137144 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137148 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137151 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137154 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137157 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137160 2564 flags.go:64] FLAG: --cgroup-root="" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137163 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137166 2564 flags.go:64] FLAG: --client-ca-file="" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137169 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137171 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137175 2564 flags.go:64] FLAG: --cluster-domain="" Jul 09 21:51:09.482561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137178 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137181 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137184 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137187 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137191 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137193 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137196 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137199 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137202 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137205 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137208 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137211 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137213 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137219 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137222 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137225 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137227 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137230 2564 flags.go:64] FLAG: --enable-server="true" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137235 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137239 2564 flags.go:64] FLAG: --event-burst="100" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137242 2564 flags.go:64] FLAG: --event-qps="50" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137245 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137249 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137252 2564 flags.go:64] FLAG: --eviction-hard="" Jul 09 21:51:09.483154 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137256 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137258 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137261 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137264 2564 flags.go:64] FLAG: --eviction-soft="" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137267 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137269 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137272 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137275 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137278 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137281 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137284 2564 flags.go:64] FLAG: --feature-gates="" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137287 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137290 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137293 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137296 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137299 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137302 2564 flags.go:64] FLAG: --help="false" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137304 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137307 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137310 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137327 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137332 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137336 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137338 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 21:51:09.483813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137341 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137344 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137347 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137350 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137353 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137356 2564 flags.go:64] FLAG: --kube-reserved="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137360 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137363 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137366 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137368 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137371 2564 flags.go:64] FLAG: --lock-file="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137374 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137376 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137379 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137384 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137387 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137390 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137392 2564 flags.go:64] FLAG: --logging-format="text" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137395 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137398 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137401 2564 flags.go:64] FLAG: --manifest-url="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137404 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137408 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137410 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137414 2564 flags.go:64] FLAG: --max-pods="110" Jul 09 21:51:09.484494 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137417 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137420 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137422 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137425 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137429 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137432 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137435 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137441 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137444 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137447 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137450 2564 flags.go:64] FLAG: --pod-cidr="" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137453 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137458 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137462 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137465 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137468 2564 flags.go:64] FLAG: --port="10250" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137471 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137473 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-068089477e7ec9e7a" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137476 2564 flags.go:64] FLAG: --qos-reserved="" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137479 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137482 2564 flags.go:64] FLAG: --register-node="true" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137484 2564 flags.go:64] FLAG: --register-with-taints="" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137488 2564 flags.go:64] FLAG: --registry-burst="10" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137490 2564 flags.go:64] FLAG: --registry-qps="5" Jul 09 21:51:09.485170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137493 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137496 2564 flags.go:64] FLAG: --reserved-memory="" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137499 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137502 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137505 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137508 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137511 2564 flags.go:64] FLAG: --runonce="false" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137513 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137516 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137519 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137522 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137524 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137527 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137531 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137534 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137537 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137540 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137542 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137545 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137548 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137554 2564 flags.go:64] FLAG: --system-cgroups="" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137559 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137565 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137567 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137570 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 21:51:09.485837 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137574 2564 flags.go:64] FLAG: --tls-min-version="" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137576 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137579 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137582 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137584 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137587 2564 flags.go:64] FLAG: --v="2" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137591 2564 flags.go:64] FLAG: --version="false" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137594 2564 flags.go:64] FLAG: --vmodule="" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137598 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.137601 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137707 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137712 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137716 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137721 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137725 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137728 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137731 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137733 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137736 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137738 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137742 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.486569 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137744 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137747 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137750 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137752 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137754 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137757 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137759 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137764 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137767 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137770 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137772 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137775 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137777 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137779 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137782 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137784 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137787 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137789 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137792 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137795 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.489277 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137797 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137799 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137802 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137804 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137807 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137809 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137811 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137815 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137819 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137822 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137824 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137829 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137831 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137834 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137836 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137838 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137841 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137847 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.489904 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137851 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137855 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137858 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137861 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137864 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137867 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137869 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137872 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137875 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137878 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137881 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137884 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137886 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137889 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137892 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137901 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137904 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137906 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137909 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137911 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.643301 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137913 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137916 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137918 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137921 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137925 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137927 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137930 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137932 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137935 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137937 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137940 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137942 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137946 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137949 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137952 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137955 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137957 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137959 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137962 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137964 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.643986 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137967 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137970 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137972 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137975 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137977 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137979 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137982 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137984 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.137986 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.138616 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.144942 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.144957 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.145665 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.145672 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145724 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.644578 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145730 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145734 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145738 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145741 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145745 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145748 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145751 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145754 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145756 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145759 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145762 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145765 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145768 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145771 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145776 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145778 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145782 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145784 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145787 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145789 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.645012 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145792 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145795 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145797 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145800 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145802 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145805 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145808 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145810 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145814 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145816 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145819 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145821 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145824 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145826 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145828 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145831 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145833 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145836 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145838 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145841 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.645541 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145843 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145846 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145849 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145851 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145853 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145856 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145860 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145862 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145868 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145872 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145874 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145877 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145880 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145882 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145885 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145887 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145889 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145921 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145925 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.646095 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145928 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145931 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145935 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145938 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145940 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145943 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145945 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145948 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145951 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145954 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145956 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145959 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145962 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145964 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145967 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145969 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145972 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145974 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145977 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.145981 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.646596 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146153 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146170 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146173 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146176 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146392 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146584 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146601 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146604 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146607 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146801 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146817 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.146820 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147014 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147030 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147033 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147225 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147241 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147243 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.647139 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147246 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.147456 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147742 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147764 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147767 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147770 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147772 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147775 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147791 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147794 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147797 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.147989 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148005 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148008 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148201 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 21:51:09.647618 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148218 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148221 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148223 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148427 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148430 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148433 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148437 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148441 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148444 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148447 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148449 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148452 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148455 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148458 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148460 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148464 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148466 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148469 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148472 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 21:51:09.648056 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148476 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148479 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148482 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148485 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148487 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148490 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148492 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148494 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148497 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148499 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148502 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148504 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148508 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148511 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148514 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148516 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148519 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148521 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148524 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148527 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 21:51:09.648568 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148529 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148531 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148534 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148536 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148540 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148543 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148545 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148548 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148550 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148553 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148556 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148560 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148563 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148565 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148568 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148570 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148573 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148575 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 21:51:09.649111 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148577 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148580 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148582 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148585 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148587 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148591 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148595 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148597 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148600 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148602 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148605 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148607 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148610 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148612 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148614 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148617 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148619 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148622 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148624 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148627 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 21:51:09.649608 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148629 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148631 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148634 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148637 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148640 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148642 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148645 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:09.148647 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.148652 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.148741 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.151937 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.153304 2564 server.go:1019] "Starting client certificate rotation" Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.153411 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 21:51:09.650159 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.153474 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.155659 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.156737 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.166220 2564 log.go:25] "Validated CRI v1 runtime API" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.168159 2564 log.go:25] "Validated CRI v1 image API" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.170941 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.173186 2564 fs.go:135] Filesystem UUIDs: map[5407ca04-3620-4f45-bcd7-30879ad98c16:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c22d38f2-ca3b-4b33-b95b-b7b05fee1615:/dev/nvme0n1p4] Jul 09 21:51:09.650536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.173200 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.177949 2564 manager.go:216] Machine: {Timestamp:2026-07-09 21:51:09.17671896 +0000 UTC m=+0.301689274 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3216266 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27054797bb4b5c8cc6a0c654580e65 SystemUUID:ec270547-97bb-4b5c-8cc6-a0c654580e65 BootID:c789bea3-bbb5-46ff-938c-f672694456e9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:b7:82:31:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:b7:82:31:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:50:53:f7:ef:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.178035 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.178100 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181180 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181206 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181869 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181878 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181886 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.181905 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.182080 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.183158 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186004 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186109 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186134 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186142 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186152 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 21:51:09.650826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186160 2564 kubelet.go:398] "Adding apiserver pod source" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186169 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186447 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.186461 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.188331 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.190085 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.190111 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191245 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191262 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191269 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191276 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191294 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191301 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191311 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191338 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191346 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191360 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191377 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.191382 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.192868 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.192878 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.195764 2564 server.go:1268] "Started kubelet" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.195836 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.196628 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.196887 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.197185 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.197263 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.197330 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.198054 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.198910 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.201923 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.202029 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28nqh" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.203580 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.203587 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.203699 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204240 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204243 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204263 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204337 2564 factory.go:55] Registering systemd factory Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204351 2564 factory.go:223] Registration of the systemd container factory successfully Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204353 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 09 21:51:09.651352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.204364 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.203785 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-173.ec2.internal.18c0bd8dcec484eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-173.ec2.internal,UID:ip-10-0-133-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-173.ec2.internal,},FirstTimestamp:2026-07-09 21:51:09.195740395 +0000 UTC m=+0.320710711,LastTimestamp:2026-07-09 21:51:09.195740395 +0000 UTC m=+0.320710711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-173.ec2.internal,}" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.205644 2564 factory.go:153] Registering CRI-O factory Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.205655 2564 factory.go:223] Registration of the crio container factory successfully Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.205705 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.205729 2564 factory.go:103] Registering Raw factory Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.205743 2564 manager.go:1196] Started watching for new ooms in manager Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.208863 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.209018 2564 manager.go:349] Starting recovery of all containers Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.209066 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28nqh" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.215069 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.219073 2564 manager.go:354] Recovery completed Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.222940 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230108 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230138 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230153 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230630 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230630 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230662 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.230681 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231387 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231420 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231433 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231744 2564 policy_none.go:49] "None policy: Start" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231758 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.231767 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.232656 2564 policy_none.go:47] "Start" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.303804 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.327943 2564 manager.go:337] "Starting Device Plugin manager" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.327965 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.327974 2564 server.go:87] "Starting device plugin registration server" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.328182 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.328194 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.328264 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.328344 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.328352 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.328844 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.328892 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.416587 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-173.ec2.internal\" not found" node="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.428747 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.652378 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.429622 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.429647 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.429661 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.429689 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.436349 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.436363 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-173.ec2.internal\": node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.443530 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.444621 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.444653 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.444672 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.444699 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.447280 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.451117 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.544965 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"] Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.545126 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.547156 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.547177 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.547187 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.548416 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.548526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.548549 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549022 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549042 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549022 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549053 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549065 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.549076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.550063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.550084 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.550668 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.550695 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.550709 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.551233 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.575846 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-173.ec2.internal\" not found" node="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.580181 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-173.ec2.internal\" not found" node="ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.605972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.818404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.606605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.606824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee0b5653ffdcb1b1efc3d6a28d433ffd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"ee0b5653ffdcb1b1efc3d6a28d433ffd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.651619 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee0b5653ffdcb1b1efc3d6a28d433ffd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"ee0b5653ffdcb1b1efc3d6a28d433ffd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707796 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee0b5653ffdcb1b1efc3d6a28d433ffd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"ee0b5653ffdcb1b1efc3d6a28d433ffd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.707822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf3a4244f4d059249e1fa0b56ee6909a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"cf3a4244f4d059249e1fa0b56ee6909a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:09.819801 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.751822 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:11.110011 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:09.852294 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:11.110011 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.878436 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:11.110011 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:09.883087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:11.110011 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.100667 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found" Jul 09 21:51:11.244331 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.172050 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.252214 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.263645 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.265298 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.274867 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.301000 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.301082 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.301115 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.301125 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.334866 2564 apiserver.go:52] "Watching apiserver" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.352276 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.353508 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.354435 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-psgpd","openshift-network-diagnostics/network-check-target-5hxbg","openshift-network-operator/iptables-alerter-7c946","kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q","openshift-dns/node-resolver-8tlch","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal","openshift-multus/network-metrics-daemon-zwvrl","openshift-ovn-kubernetes/ovnkube-node-zcz29","kube-system/global-pull-secret-syncer-hfnsm","kube-system/konnectivity-agent-5pr67","openshift-cluster-node-tuning-operator/tuned-pznh2","openshift-image-registry/node-ca-tzjzm","openshift-multus/multus-additional-cni-plugins-b8lc2"] Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.356100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.357218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.357273 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.358543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359636 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 21:46:10 +0000 UTC" deadline="2028-01-16 23:06:54.705646938 +0000 UTC" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359662 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13345h15m43.345987207s" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359751 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.359885 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.360046 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4p4v6\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361232 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361279 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5sg5g\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361655 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.361849 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.375893 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.362170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.362416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.362417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.362752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.362819 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fpzfs\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.363129 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.363865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364297 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mzb2r\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364348 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.364906 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.364982 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.365270 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h5925\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.366165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.366191 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.366192 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4bhg\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.367705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.368951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.368998 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.369973 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.369980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.370117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.370325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.370421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtdk7\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.371040 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.371098 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.371368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.371381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.372392 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9vgl5\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.372417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.373217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.373737 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 21:51:11.378099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.373896 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 21:51:11.379109 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.374234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5w9t4\"" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.381617 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nvckf" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.389742 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nvckf" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.453501 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-cni-binary-copy\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-bin\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-config\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-socket-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-kubernetes\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-run\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-netd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2836d8a-7187-4aa7-93da-4d8e777161e9-host-slash\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-os-release\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-conf-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-systemd-units\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-daemon-config\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.515526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-netns\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b53b3852-033a-461c-97a4-0d6c3a74159a-host\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxhd6\" (UniqueName: \"kubernetes.io/projected/b53b3852-033a-461c-97a4-0d6c3a74159a-kube-api-access-qxhd6\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-etc-kubernetes\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmc4b\" (UniqueName: \"kubernetes.io/projected/2218784c-75ba-483b-9c4a-86e60c8a8be9-kube-api-access-gmc4b\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-env-overrides\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-script-lib\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8e53632-4f60-484c-9420-17fcf039bf28-agent-certs\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-sys\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-cnibin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-socket-dir-parent\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-netns\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwhxq\" (UniqueName: \"kubernetes.io/projected/fe1d2ecf-648d-4d17-87fb-d31725c89939-kube-api-access-kwhxq\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-log-socket\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.516749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-dbus\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2836d8a-7187-4aa7-93da-4d8e777161e9-iptables-alerter-script\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-bin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.458998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-var-lib-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-registration-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85ef31c-336f-44ff-b5d5-44f95a8cd592-tmp-dir\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-kubelet-config\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6l9f\" (UniqueName: \"kubernetes.io/projected/a0780c58-9d73-4a0c-98b7-93b16484e686-kube-api-access-q6l9f\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tt4\" (UniqueName: \"kubernetes.io/projected/9e46c188-85d5-4f26-80a8-303bc84378d1-kube-api-access-88tt4\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85ef31c-336f-44ff-b5d5-44f95a8cd592-hosts-file\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8e53632-4f60-484c-9420-17fcf039bf28-konnectivity-ca\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-conf\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-host\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.517633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-multus\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-os-release\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-ovn\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-tuned\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysconfig\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-tmp\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-hostroot\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-multus-certs\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgqt\" (UniqueName: \"kubernetes.io/projected/6a5232a8-afaf-44e9-9832-127894abb1b7-kube-api-access-6cgqt\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-slash\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-etc-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lcf\" (UniqueName: \"kubernetes.io/projected/b85ef31c-336f-44ff-b5d5-44f95a8cd592-kube-api-access-f2lcf\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-systemd\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0780c58-9d73-4a0c-98b7-93b16484e686-ovn-node-metrics-cert\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-k8s-cni-cncf-io\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.518782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-system-cni-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-lib-modules\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-system-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-kubelet\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-cnibin\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-kubelet\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-systemd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-node-log\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b53b3852-033a-461c-97a4-0d6c3a74159a-serviceca\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-device-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.519855 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-sys-fs\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.521008 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-modprobe-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.521008 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-var-lib-kubelet\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.521008 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65fl\" (UniqueName: \"kubernetes.io/projected/29d42392-fd67-471a-8c42-d2d0d81d9db0-kube-api-access-x65fl\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.521008 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.459914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrvj\" (UniqueName: \"kubernetes.io/projected/a2836d8a-7187-4aa7-93da-4d8e777161e9-kube-api-access-kdrvj\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-netd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2836d8a-7187-4aa7-93da-4d8e777161e9-host-slash\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-os-release\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-conf-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-netd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-systemd-units\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-conf-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560708 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-systemd-units\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2836d8a-7187-4aa7-93da-4d8e777161e9-host-slash\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-os-release\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.560785 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-daemon-config\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-netns\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.560833 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-netns\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667111 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.560838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:12.060822206 +0000 UTC m=+2.037960767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b53b3852-033a-461c-97a4-0d6c3a74159a-host\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b53b3852-033a-461c-97a4-0d6c3a74159a-host\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxhd6\" (UniqueName: \"kubernetes.io/projected/b53b3852-033a-461c-97a4-0d6c3a74159a-kube-api-access-qxhd6\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.560945 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:12.060929713 +0000 UTC m=+2.038068273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-etc-kubernetes\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.560993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmc4b\" (UniqueName: \"kubernetes.io/projected/2218784c-75ba-483b-9c4a-86e60c8a8be9-kube-api-access-gmc4b\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561007 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-etc-kubernetes\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-env-overrides\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-script-lib\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8e53632-4f60-484c-9420-17fcf039bf28-agent-certs\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-sys\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-cnibin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-socket-dir-parent\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-sys\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-netns\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.667860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwhxq\" (UniqueName: \"kubernetes.io/projected/fe1d2ecf-648d-4d17-87fb-d31725c89939-kube-api-access-kwhxq\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-daemon-config\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-socket-dir-parent\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561707 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-log-socket\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-env-overrides\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-netns\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-dbus\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.561906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2836d8a-7187-4aa7-93da-4d8e777161e9-iptables-alerter-script\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562074 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-script-lib\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-bin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-cnibin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-log-socket\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-var-lib-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.668380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-registration-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-dbus\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85ef31c-336f-44ff-b5d5-44f95a8cd592-tmp-dir\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562387 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-var-lib-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-kubelet-config\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-bin\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-registration-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6l9f\" (UniqueName: \"kubernetes.io/projected/a0780c58-9d73-4a0c-98b7-93b16484e686-kube-api-access-q6l9f\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2836d8a-7187-4aa7-93da-4d8e777161e9-iptables-alerter-script\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88tt4\" (UniqueName: \"kubernetes.io/projected/9e46c188-85d5-4f26-80a8-303bc84378d1-kube-api-access-88tt4\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85ef31c-336f-44ff-b5d5-44f95a8cd592-hosts-file\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8e53632-4f60-484c-9420-17fcf039bf28-konnectivity-ca\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562906 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85ef31c-336f-44ff-b5d5-44f95a8cd592-hosts-file\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.668992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-conf\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-host\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.562993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-multus\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-os-release\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-ovn\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-conf\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-tuned\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysconfig\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysctl-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-tmp\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85ef31c-336f-44ff-b5d5-44f95a8cd592-tmp-dir\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-hostroot\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-multus-certs\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-host\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgqt\" (UniqueName: \"kubernetes.io/projected/6a5232a8-afaf-44e9-9832-127894abb1b7-kube-api-access-6cgqt\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563352 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-cni-multus\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-slash\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8e53632-4f60-484c-9420-17fcf039bf28-konnectivity-ca\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-slash\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-etc-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-etc-openvswitch\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lcf\" (UniqueName: \"kubernetes.io/projected/b85ef31c-336f-44ff-b5d5-44f95a8cd592-kube-api-access-f2lcf\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-systemd\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-os-release\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0780c58-9d73-4a0c-98b7-93b16484e686-ovn-node-metrics-cert\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-k8s-cni-cncf-io\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-ovn\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-system-cni-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563627 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-kubelet-config\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563652 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-multus-certs\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-lib-modules\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-systemd\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-system-cni-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.670639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563768 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-run-k8s-cni-cncf-io\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.563830 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-hostroot\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564274 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-lib-modules\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-system-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-kubelet\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-cnibin\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-kubelet\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-systemd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-node-log\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-sysconfig\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b53b3852-033a-461c-97a4-0d6c3a74159a-serviceca\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.671199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-device-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-sys-fs\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-modprobe-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-var-lib-kubelet\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65fl\" (UniqueName: \"kubernetes.io/projected/29d42392-fd67-471a-8c42-d2d0d81d9db0-kube-api-access-x65fl\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrvj\" (UniqueName: \"kubernetes.io/projected/a2836d8a-7187-4aa7-93da-4d8e777161e9-kube-api-access-kdrvj\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-system-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-host-var-lib-kubelet\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-cni-binary-copy\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-bin\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-config\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b53b3852-033a-461c-97a4-0d6c3a74159a-serviceca\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.564997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-socket-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-socket-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-var-lib-kubelet\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.671803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-device-dir\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e46c188-85d5-4f26-80a8-303bc84378d1-sys-fs\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-kubernetes\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-run\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565416 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-modprobe-d\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-run\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1d2ecf-648d-4d17-87fb-d31725c89939-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-run-systemd\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-node-log\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5232a8-afaf-44e9-9832-127894abb1b7-multus-cni-dir\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.565810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1d2ecf-648d-4d17-87fb-d31725c89939-cnibin\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.566263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5232a8-afaf-44e9-9832-127894abb1b7-cni-binary-copy\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.566329 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-kubelet\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.566358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-kubernetes\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.566384 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0780c58-9d73-4a0c-98b7-93b16484e686-host-cni-bin\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.566975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8e53632-4f60-484c-9420-17fcf039bf28-agent-certs\") pod \"konnectivity-agent-5pr67\" (UID: \"b8e53632-4f60-484c-9420-17fcf039bf28\") " pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.567062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0780c58-9d73-4a0c-98b7-93b16484e686-ovnkube-config\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672347 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.568397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-etc-tuned\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.568446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d42392-fd67-471a-8c42-d2d0d81d9db0-tmp\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.568519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0780c58-9d73-4a0c-98b7-93b16484e686-ovn-node-metrics-cert\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.570331 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.570353 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.570366 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:11.570429 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:12.070412782 +0000 UTC m=+2.047551359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.572056 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxhd6\" (UniqueName: \"kubernetes.io/projected/b53b3852-033a-461c-97a4-0d6c3a74159a-kube-api-access-qxhd6\") pod \"node-ca-tzjzm\" (UID: \"b53b3852-033a-461c-97a4-0d6c3a74159a\") " pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.572497 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmc4b\" (UniqueName: \"kubernetes.io/projected/2218784c-75ba-483b-9c4a-86e60c8a8be9-kube-api-access-gmc4b\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.572701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tt4\" (UniqueName: \"kubernetes.io/projected/9e46c188-85d5-4f26-80a8-303bc84378d1-kube-api-access-88tt4\") pod \"aws-ebs-csi-driver-node-mrv4q\" (UID: \"9e46c188-85d5-4f26-80a8-303bc84378d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.572897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgqt\" (UniqueName: \"kubernetes.io/projected/6a5232a8-afaf-44e9-9832-127894abb1b7-kube-api-access-6cgqt\") pod \"multus-psgpd\" (UID: \"6a5232a8-afaf-44e9-9832-127894abb1b7\") " pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.573359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwhxq\" (UniqueName: \"kubernetes.io/projected/fe1d2ecf-648d-4d17-87fb-d31725c89939-kube-api-access-kwhxq\") pod \"multus-additional-cni-plugins-b8lc2\" (UID: \"fe1d2ecf-648d-4d17-87fb-d31725c89939\") " pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.573420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lcf\" (UniqueName: \"kubernetes.io/projected/b85ef31c-336f-44ff-b5d5-44f95a8cd592-kube-api-access-f2lcf\") pod \"node-resolver-8tlch\" (UID: \"b85ef31c-336f-44ff-b5d5-44f95a8cd592\") " pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.573705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrvj\" (UniqueName: \"kubernetes.io/projected/a2836d8a-7187-4aa7-93da-4d8e777161e9-kube-api-access-kdrvj\") pod \"iptables-alerter-7c946\" (UID: \"a2836d8a-7187-4aa7-93da-4d8e777161e9\") " pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.574242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65fl\" (UniqueName: \"kubernetes.io/projected/29d42392-fd67-471a-8c42-d2d0d81d9db0-kube-api-access-x65fl\") pod \"tuned-pznh2\" (UID: \"29d42392-fd67-471a-8c42-d2d0d81d9db0\") " pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.576285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6l9f\" (UniqueName: \"kubernetes.io/projected/a0780c58-9d73-4a0c-98b7-93b16484e686-kube-api-access-q6l9f\") pod \"ovnkube-node-zcz29\" (UID: \"a0780c58-9d73-4a0c-98b7-93b16484e686\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.583432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pznh2" Jul 09 21:51:11.672890 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.634780 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3a4244f4d059249e1fa0b56ee6909a.slice/crio-a0192f9b90e90955111fe10bd27dc46edb878351cf0971e52b8b97813abb9a76 WatchSource:0}: Error finding container a0192f9b90e90955111fe10bd27dc46edb878351cf0971e52b8b97813abb9a76: Status 404 returned error can't find the container with id a0192f9b90e90955111fe10bd27dc46edb878351cf0971e52b8b97813abb9a76 Jul 09 21:51:11.673592 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.635189 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d42392_fd67_471a_8c42_d2d0d81d9db0.slice/crio-8811254b52f2e14574578ec25f03f8e167d437624f1577179c9fe74c5f139c6b WatchSource:0}: Error finding container 8811254b52f2e14574578ec25f03f8e167d437624f1577179c9fe74c5f139c6b: Status 404 returned error can't find the container with id 8811254b52f2e14574578ec25f03f8e167d437624f1577179c9fe74c5f139c6b Jul 09 21:51:11.673592 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.635948 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0b5653ffdcb1b1efc3d6a28d433ffd.slice/crio-c56bc7cd4e9fd8d34aab48fcb140b049e5f4b984be53e7bbdc3ee89007a66aa3 WatchSource:0}: Error finding container c56bc7cd4e9fd8d34aab48fcb140b049e5f4b984be53e7bbdc3ee89007a66aa3: Status 404 returned error can't find the container with id c56bc7cd4e9fd8d34aab48fcb140b049e5f4b984be53e7bbdc3ee89007a66aa3 Jul 09 21:51:11.673592 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.640541 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.684587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tzjzm" Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.696649 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53b3852_033a_461c_97a4_0d6c3a74159a.slice/crio-111b9c35ba9371048a36ccf0e65e91a607af5797e2884e3e27692ae195fa2132 WatchSource:0}: Error finding container 111b9c35ba9371048a36ccf0e65e91a607af5797e2884e3e27692ae195fa2132: Status 404 returned error can't find the container with id 111b9c35ba9371048a36ccf0e65e91a607af5797e2884e3e27692ae195fa2132 Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.727984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c946" Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.735124 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2836d8a_7187_4aa7_93da_4d8e777161e9.slice/crio-4e00e25ad07622d7f07d4a0cb213a6fbad1e0c195f136ae44de0db5b823b1a50 WatchSource:0}: Error finding container 4e00e25ad07622d7f07d4a0cb213a6fbad1e0c195f136ae44de0db5b823b1a50: Status 404 returned error can't find the container with id 4e00e25ad07622d7f07d4a0cb213a6fbad1e0c195f136ae44de0db5b823b1a50 Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.747968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-psgpd" Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.755020 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5232a8_afaf_44e9_9832_127894abb1b7.slice/crio-76c902436a2c85d427181d84866b1836bad179eebe424e666e90cefa6f885434 WatchSource:0}: Error finding container 76c902436a2c85d427181d84866b1836bad179eebe424e666e90cefa6f885434: Status 404 returned error can't find the container with id 76c902436a2c85d427181d84866b1836bad179eebe424e666e90cefa6f885434 Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.764413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" Jul 09 21:51:11.772231 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.767994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tlch" Jul 09 21:51:11.776093 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.775723 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85ef31c_336f_44ff_b5d5_44f95a8cd592.slice/crio-4af642adbc12adf0be38f033371f320e13e49cb3b80514268033de311589cd83 WatchSource:0}: Error finding container 4af642adbc12adf0be38f033371f320e13e49cb3b80514268033de311589cd83: Status 404 returned error can't find the container with id 4af642adbc12adf0be38f033371f320e13e49cb3b80514268033de311589cd83 Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.816204 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.830598 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1d2ecf_648d_4d17_87fb_d31725c89939.slice/crio-0628336ea1688e114ff695739068a0b0c6e775dce284105b78afecee5a0fde77 WatchSource:0}: Error finding container 0628336ea1688e114ff695739068a0b0c6e775dce284105b78afecee5a0fde77: Status 404 returned error can't find the container with id 0628336ea1688e114ff695739068a0b0c6e775dce284105b78afecee5a0fde77 Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.840901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.847960 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0780c58_9d73_4a0c_98b7_93b16484e686.slice/crio-a43d345d7d2aaf11e68efc02dd3716e5ea1e1b280ac81b2377c7704a6ba0da0e WatchSource:0}: Error finding container a43d345d7d2aaf11e68efc02dd3716e5ea1e1b280ac81b2377c7704a6ba0da0e: Status 404 returned error can't find the container with id a43d345d7d2aaf11e68efc02dd3716e5ea1e1b280ac81b2377c7704a6ba0da0e Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.861758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:11.869838 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e53632_4f60_484c_9420_17fcf039bf28.slice/crio-aada14c63d49f436a00d8b7fd66d00e23fa0846f3dcdad2580bd109b6ae5cd74 WatchSource:0}: Error finding container aada14c63d49f436a00d8b7fd66d00e23fa0846f3dcdad2580bd109b6ae5cd74: Status 404 returned error can't find the container with id aada14c63d49f436a00d8b7fd66d00e23fa0846f3dcdad2580bd109b6ae5cd74 Jul 09 21:51:11.905303 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:11.904675 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.069369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.069391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.069481 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.069487 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.069522 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:13.069508163 +0000 UTC m=+3.046646721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:12.070083 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.069535 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:13.069529102 +0000 UTC m=+3.046667659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:12.225596 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.170341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:12.225596 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.170487 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:12.225596 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.170504 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:12.225596 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.170515 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:12.225596 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.170564 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:13.170548062 +0000 UTC m=+3.147686625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:12.430849 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.391889 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 21:46:11 +0000 UTC" deadline="2028-01-24 22:18:35.520198889 +0000 UTC" Jul 09 21:51:12.430849 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.391949 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13536h27m23.12825317s" Jul 09 21:51:12.430849 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.412349 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:12.596096 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.596034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:12.596303 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.596266 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:12.596685 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.596659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:12.596772 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:12.596752 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:12.630414 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.630366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerStarted","Data":"0628336ea1688e114ff695739068a0b0c6e775dce284105b78afecee5a0fde77"} Jul 09 21:51:12.644007 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.643926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tlch" event={"ID":"b85ef31c-336f-44ff-b5d5-44f95a8cd592","Type":"ContainerStarted","Data":"4af642adbc12adf0be38f033371f320e13e49cb3b80514268033de311589cd83"} Jul 09 21:51:12.651592 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.651526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c946" event={"ID":"a2836d8a-7187-4aa7-93da-4d8e777161e9","Type":"ContainerStarted","Data":"4e00e25ad07622d7f07d4a0cb213a6fbad1e0c195f136ae44de0db5b823b1a50"} Jul 09 21:51:12.663124 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.663101 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tzjzm" event={"ID":"b53b3852-033a-461c-97a4-0d6c3a74159a","Type":"ContainerStarted","Data":"111b9c35ba9371048a36ccf0e65e91a607af5797e2884e3e27692ae195fa2132"} Jul 09 21:51:12.668965 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.668942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pr67" event={"ID":"b8e53632-4f60-484c-9420-17fcf039bf28","Type":"ContainerStarted","Data":"aada14c63d49f436a00d8b7fd66d00e23fa0846f3dcdad2580bd109b6ae5cd74"} Jul 09 21:51:12.670668 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.670642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" event={"ID":"9e46c188-85d5-4f26-80a8-303bc84378d1","Type":"ContainerStarted","Data":"f9f76d7d55e83a88a4ca38997dd40102c882549f6e3b4e0f203b93f1a7dd9be3"} Jul 09 21:51:12.691891 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.691830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-psgpd" event={"ID":"6a5232a8-afaf-44e9-9832-127894abb1b7","Type":"ContainerStarted","Data":"76c902436a2c85d427181d84866b1836bad179eebe424e666e90cefa6f885434"} Jul 09 21:51:12.697200 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.697116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" event={"ID":"ee0b5653ffdcb1b1efc3d6a28d433ffd","Type":"ContainerStarted","Data":"c56bc7cd4e9fd8d34aab48fcb140b049e5f4b984be53e7bbdc3ee89007a66aa3"} Jul 09 21:51:12.705515 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.705455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pznh2" event={"ID":"29d42392-fd67-471a-8c42-d2d0d81d9db0","Type":"ContainerStarted","Data":"8811254b52f2e14574578ec25f03f8e167d437624f1577179c9fe74c5f139c6b"} Jul 09 21:51:12.711794 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.711737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"cf3a4244f4d059249e1fa0b56ee6909a","Type":"ContainerStarted","Data":"a0192f9b90e90955111fe10bd27dc46edb878351cf0971e52b8b97813abb9a76"} Jul 09 21:51:12.723380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.723355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"a43d345d7d2aaf11e68efc02dd3716e5ea1e1b280ac81b2377c7704a6ba0da0e"} Jul 09 21:51:12.757996 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.757976 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:12.979085 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:12.979012 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 21:51:13.080171 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.079939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:13.080171 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.079984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:13.080914 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.080456 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:13.080914 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.080522 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:15.08050245 +0000 UTC m=+5.057641029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:13.081300 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.080140 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:13.081300 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.081243 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:15.081217237 +0000 UTC m=+5.058355796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:13.181242 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.181203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:13.181401 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.181386 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:13.181469 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.181413 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:13.181469 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.181432 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:13.181642 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.181484 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:15.181467901 +0000 UTC m=+5.158606463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:13.393116 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.393011 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 21:46:11 +0000 UTC" deadline="2028-01-23 16:44:32.360444964 +0000 UTC" Jul 09 21:51:13.393116 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.393066 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13506h53m18.967381846s" Jul 09 21:51:13.592766 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:13.592733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:13.593443 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:13.592859 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:14.596282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:14.595624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:14.596282 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:14.595758 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:14.596282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:14.596112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:14.596282 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:14.596213 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:15.097324 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:15.097295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:15.097453 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:15.097341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:15.097453 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.097411 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:15.097569 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.097480 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:19.097457579 +0000 UTC m=+9.074596150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:15.097569 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.097482 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:15.097569 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.097532 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:19.097518321 +0000 UTC m=+9.074656898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:15.198511 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:15.198480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:15.198680 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.198646 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:15.198680 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.198669 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:15.198680 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.198681 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:15.198853 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.198734 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:19.198717857 +0000 UTC m=+9.175856419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:15.593430 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:15.592942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:15.593430 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:15.593066 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:16.593097 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:16.593066 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:16.593545 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:16.593220 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:16.593545 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:16.593066 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:16.593664 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:16.593561 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:17.593637 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:17.593593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:17.594067 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:17.593730 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:18.593691 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:18.593621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:18.593691 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:18.593647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:18.594218 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:18.593767 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:18.594218 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:18.593982 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:19.127817 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:19.127782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:19.127992 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:19.127834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:19.127992 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.127896 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:19.127992 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.127933 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:19.127992 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.127963 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:27.127947533 +0000 UTC m=+17.105086106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:19.127992 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.127978 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:27.12797226 +0000 UTC m=+17.105110817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:19.228854 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:19.228822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:19.229005 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.228987 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:19.229064 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.229011 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:19.229064 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.229024 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:19.229197 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.229081 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:27.229062438 +0000 UTC m=+17.206201010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:19.593122 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:19.593093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:19.593292 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:19.593222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:20.593964 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:20.593936 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:20.594396 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:20.594048 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:20.594396 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:20.594104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:20.594396 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:20.594234 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:21.592857 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:21.592817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:21.593022 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:21.592945 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:22.593540 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:22.593513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:22.593938 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:22.593519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:22.593938 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:22.593658 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:22.593938 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:22.593717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:23.592916 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:23.592880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:23.593077 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:23.592999 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:24.593111 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:24.593080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:24.593525 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:24.593208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:24.593525 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:24.593275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:24.593525 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:24.593370 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:25.593319 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:25.593292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:25.593776 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:25.593381 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:26.593302 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:26.593278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:26.593403 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:26.593283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:26.593403 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:26.593376 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:26.593693 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:26.593448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:27.189989 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:27.189960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:27.189989 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:27.189995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:27.190266 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.190109 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:27.190266 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.190181 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:43.190166092 +0000 UTC m=+33.167304654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:27.190266 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.190109 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:27.190266 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.190237 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:43.190224534 +0000 UTC m=+33.167363091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:27.291685 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:27.291618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:27.292043 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.292021 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:27.292119 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.292051 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:27.292119 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.292065 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:27.292227 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.292120 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:43.292103096 +0000 UTC m=+33.269241656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:27.592982 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:27.592746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:27.593189 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:27.593087 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:28.592965 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:28.592935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:28.593392 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:28.592939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:28.593392 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:28.593058 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:28.593392 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:28.593128 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:29.593664 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:29.593636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:29.594049 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:29.593743 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:30.593688 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:30.593659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:30.594038 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:30.593756 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:30.594038 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:30.593822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:30.594038 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:30.593906 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:31.593027 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.592879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:31.593111 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:31.593091 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:31.768589 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.768561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-psgpd" event={"ID":"6a5232a8-afaf-44e9-9832-127894abb1b7","Type":"ContainerStarted","Data":"6729650067efbfe69090f5b53533257f630be311a9945d6dd975a044cd57bdf9"} Jul 09 21:51:31.769997 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.769968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" event={"ID":"ee0b5653ffdcb1b1efc3d6a28d433ffd","Type":"ContainerStarted","Data":"7617aac9cd2a41d35bbd44024a1503b640b055de24a3afd0940a848827cbebf0"} Jul 09 21:51:31.771404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.771377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pznh2" event={"ID":"29d42392-fd67-471a-8c42-d2d0d81d9db0","Type":"ContainerStarted","Data":"275244048b7eff8ae92dd9026bda851aa1b0cb5613cccb306fbac8eb1f220a78"} Jul 09 21:51:31.774293 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:51:31.774655 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774633 2564 generic.go:356] "Generic (PLEG): container finished" podID="a0780c58-9d73-4a0c-98b7-93b16484e686" containerID="9eac769aa222cc07ed216bb966282c1a52d92156bce836956277bf8e120f2de0" exitCode=1 Jul 09 21:51:31.774731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"997cd200c52b345f771079caadf538fe84cacda85cfd8c7035de133031dd1e00"} Jul 09 21:51:31.774731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"4c784bc17378ec5c829977a7130fd42bcd808830866f9da4d1429909947ea6a9"} Jul 09 21:51:31.774798 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"5aff38a79f0637bc3a1b6f23d22667cd42d28fa71e7be8a994b0eddc333a16e8"} Jul 09 21:51:31.774798 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"b5ed0c0767ba8c5f469311c63f05da8a70de77f91274bb755ba594b0afacf7ac"} Jul 09 21:51:31.774857 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerDied","Data":"9eac769aa222cc07ed216bb966282c1a52d92156bce836956277bf8e120f2de0"} Jul 09 21:51:31.774857 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.774842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"53d131d3c57807eb47570589a7519042c5cc48f3073040f989a0cc95d02d5ad5"} Jul 09 21:51:31.798213 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.798168 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-psgpd" podStartSLOduration=2.780173871 podStartE2EDuration="21.798130802s" totalImagesPullingTime="19.017956931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:31.78507374 +0000 UTC m=+21.762212320" watchObservedRunningTime="2026-07-09 21:51:31.798130802 +0000 UTC m=+21.775269382" Jul 09 21:51:31.798645 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:31.798437 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" podStartSLOduration=20.798425616 podStartE2EDuration="20.798425616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:31.798309088 +0000 UTC m=+21.775447679" watchObservedRunningTime="2026-07-09 21:51:31.798425616 +0000 UTC m=+21.775564195" Jul 09 21:51:32.593396 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.593239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:32.593489 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.593241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:32.593489 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:32.593469 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:32.593570 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:32.593551 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:32.778788 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.778761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pr67" event={"ID":"b8e53632-4f60-484c-9420-17fcf039bf28","Type":"ContainerStarted","Data":"85b31ec5f48b3606cee957789053ed1f3d5ae15381795c72d5d11b3ffda31aa5"} Jul 09 21:51:32.780142 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.780117 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" event={"ID":"9e46c188-85d5-4f26-80a8-303bc84378d1","Type":"ContainerStarted","Data":"f57765a2b8cd262842de9e88b48c05a61334fc901a957f3b8af9d7f2b4d695c9"} Jul 09 21:51:32.781911 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.781886 2564 generic.go:356] "Generic (PLEG): container finished" podID="cf3a4244f4d059249e1fa0b56ee6909a" containerID="0e3835ab2bbc987894b69d77311136e565d2f0762732e48bc4660e4db67b190a" exitCode=0 Jul 09 21:51:32.782006 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.781959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"cf3a4244f4d059249e1fa0b56ee6909a","Type":"ContainerDied","Data":"0e3835ab2bbc987894b69d77311136e565d2f0762732e48bc4660e4db67b190a"} Jul 09 21:51:32.783830 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.783808 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="e364951c3ce47b27dfc275016b61dc3b86d3eb3f96d51b501b4a82064a7a3d19" exitCode=0 Jul 09 21:51:32.783931 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.783885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"e364951c3ce47b27dfc275016b61dc3b86d3eb3f96d51b501b4a82064a7a3d19"} Jul 09 21:51:32.785586 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.785561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tlch" event={"ID":"b85ef31c-336f-44ff-b5d5-44f95a8cd592","Type":"ContainerStarted","Data":"9adbc6924fc423e565e86f46aa7cd485e5d4fd0acc4a47a97719efc674d04f02"} Jul 09 21:51:32.787193 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.787171 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c946" event={"ID":"a2836d8a-7187-4aa7-93da-4d8e777161e9","Type":"ContainerStarted","Data":"ab580754b960082ae592123b4c7c20335ee16f9c20bd315697f68bc5b91056c9"} Jul 09 21:51:32.788886 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.788811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tzjzm" event={"ID":"b53b3852-033a-461c-97a4-0d6c3a74159a","Type":"ContainerStarted","Data":"8d90ecab4f8ed041f4679f2e2f98ecaa94cb53d16da6842db7395fb5bf00990f"} Jul 09 21:51:32.793614 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.793578 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5pr67" podStartSLOduration=3.930243686 podStartE2EDuration="22.793567395s" totalImagesPullingTime="18.863323709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:32.793336911 +0000 UTC m=+22.770475490" watchObservedRunningTime="2026-07-09 21:51:32.793567395 +0000 UTC m=+22.770706002" Jul 09 21:51:32.793714 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.793653 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pznh2" podStartSLOduration=3.693467618 podStartE2EDuration="22.793648131s" totalImagesPullingTime="19.100180513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:31.814466729 +0000 UTC m=+21.791605310" watchObservedRunningTime="2026-07-09 21:51:32.793648131 +0000 UTC m=+22.770786709" Jul 09 21:51:32.806659 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.806623 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8tlch" podStartSLOduration=3.8441598089999998 podStartE2EDuration="22.806612163s" totalImagesPullingTime="18.962452354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:32.80631069 +0000 UTC m=+22.783449260" watchObservedRunningTime="2026-07-09 21:51:32.806612163 +0000 UTC m=+22.783750742" Jul 09 21:51:32.833621 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.833587 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tzjzm" podStartSLOduration=3.792167452 podStartE2EDuration="22.833575389s" totalImagesPullingTime="19.041407937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:32.833133558 +0000 UTC m=+22.810272138" watchObservedRunningTime="2026-07-09 21:51:32.833575389 +0000 UTC m=+22.810713966" Jul 09 21:51:32.846963 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.846836 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7c946" podStartSLOduration=12.093917226 podStartE2EDuration="22.846808937s" totalImagesPullingTime="10.752891711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:32.846454044 +0000 UTC m=+22.823592623" watchObservedRunningTime="2026-07-09 21:51:32.846808937 +0000 UTC m=+22.823947515" Jul 09 21:51:32.989019 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:32.988993 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:33.040023 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.039997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:33.593575 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.593552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:33.593714 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:33.593660 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:33.632328 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.632304 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 21:51:33.793308 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.793281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" event={"ID":"9e46c188-85d5-4f26-80a8-303bc84378d1","Type":"ContainerStarted","Data":"3c42f320bb7d00499a52cf34a6b6172d9560c4077423b59c26356bc3a3fbed02"} Jul 09 21:51:33.795102 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.795061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"cf3a4244f4d059249e1fa0b56ee6909a","Type":"ContainerStarted","Data":"593a3dc578a42e46891254b006ebf963a3b5f58175be26680394c3a2f47c60f9"} Jul 09 21:51:33.809713 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:33.809671 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" podStartSLOduration=22.809655598 podStartE2EDuration="22.809655598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:33.809369098 +0000 UTC m=+23.786507677" watchObservedRunningTime="2026-07-09 21:51:33.809655598 +0000 UTC m=+23.786794177" Jul 09 21:51:34.493858 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.493775 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T21:51:33.632324988Z","UUID":"7ec7b9dd-785e-4f5c-a6bd-f0034866d533","Handler":null,"Name":"","Endpoint":""} Jul 09 21:51:34.495364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.495341 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 21:51:34.495484 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.495384 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 21:51:34.592761 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.592736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:34.592914 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.592842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:34.592914 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:34.592876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:34.593003 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:34.592936 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:34.798493 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.798468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" event={"ID":"9e46c188-85d5-4f26-80a8-303bc84378d1","Type":"ContainerStarted","Data":"2a648c07254d967ac5630e42f75edc26c814e100304604311e1e8cf0e6c0d315"} Jul 09 21:51:34.801118 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.801104 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:51:34.801482 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.801459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"34d063bdb9538551b8195a3f2a8ac1934f0786dfbb63c16855651dc8da0aca5f"} Jul 09 21:51:34.816458 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:34.816424 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrv4q" podStartSLOduration=3.431500503 podStartE2EDuration="24.816411488s" totalImagesPullingTime="21.384910985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:34.815910718 +0000 UTC m=+24.793049297" watchObservedRunningTime="2026-07-09 21:51:34.816411488 +0000 UTC m=+24.793550063" Jul 09 21:51:35.592942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:35.592913 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:35.593082 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:35.592998 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:35.939603 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:35.939495 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:35.940101 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:35.940084 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:35.958328 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:35.958309 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:35.958723 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:35.958707 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5pr67" Jul 09 21:51:36.015284 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.015260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:36.595977 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.595943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:36.596141 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:36.596049 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:36.596141 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.596100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:36.596266 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:36.596195 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:36.809538 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.809514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:51:36.809921 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.809896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"6c98507880bc5aa4e21f81b5563c207fb88dcd26b3603b406df6f02ef440750d"} Jul 09 21:51:36.810243 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.810212 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:36.810350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.810283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:36.810350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.810331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:36.810350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.810327 2564 scope.go:117] "RemoveContainer" containerID="9eac769aa222cc07ed216bb966282c1a52d92156bce836956277bf8e120f2de0" Jul 09 21:51:36.827663 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.827644 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:36.827903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:36.827885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:51:37.593143 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:37.593115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:37.593873 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:37.593246 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:37.817956 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:37.817794 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:51:37.818782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:37.818753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" event={"ID":"a0780c58-9d73-4a0c-98b7-93b16484e686","Type":"ContainerStarted","Data":"d76985da9120f824526aa931da9d1151c1dbcf8eefc7f7c4225c27a036fd61bc"} Jul 09 21:51:37.844831 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:37.844738 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" podStartSLOduration=8.554606054 podStartE2EDuration="27.844725069s" totalImagesPullingTime="19.290119015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:37.843087844 +0000 UTC m=+27.820226448" watchObservedRunningTime="2026-07-09 21:51:37.844725069 +0000 UTC m=+27.821863920" Jul 09 21:51:38.009867 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.009836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwvrl"] Jul 09 21:51:38.010029 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.009971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:38.010110 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:38.010081 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:38.015831 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.015796 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfnsm"] Jul 09 21:51:38.015913 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.015904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:38.016021 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:38.016002 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:38.016577 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.016556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5hxbg"] Jul 09 21:51:38.016665 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:38.016652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:38.016782 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:38.016757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:39.307537 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.307511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:39.408046 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.408021 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:39.593299 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.593257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:39.593299 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.593265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:39.593407 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.593260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:39.593407 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:39.593332 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:39.593476 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:39.593424 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:39.593515 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:39.593483 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:39.823901 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.823879 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="ed252fa8ded781c09cddbc0da6ef6815600976ea963018209ff544d03082d201" exitCode=0 Jul 09 21:51:39.823985 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:39.823915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"ed252fa8ded781c09cddbc0da6ef6815600976ea963018209ff544d03082d201"} Jul 09 21:51:40.827381 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:40.827351 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="0af3fe6405e2cad329023fa947be4576d33e11afd6f4af0b14cedfcc9aaae2c1" exitCode=0 Jul 09 21:51:40.827683 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:40.827390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"0af3fe6405e2cad329023fa947be4576d33e11afd6f4af0b14cedfcc9aaae2c1"} Jul 09 21:51:41.593012 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.592849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:41.593107 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.592849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:41.593176 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:41.593096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:41.593241 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:41.593202 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:41.593241 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.592892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:41.593363 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:41.593344 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:41.630886 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.630864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:41.687126 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.687107 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:41.831289 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.831243 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="5fe1d191da0ddf612c2ac635e74fe9b2817c32cd62f1b97494c365f09a3d589d" exitCode=0 Jul 09 21:51:41.831523 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:41.831285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"5fe1d191da0ddf612c2ac635e74fe9b2817c32cd62f1b97494c365f09a3d589d"} Jul 09 21:51:43.219468 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.219441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:43.219786 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.219472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:43.219786 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.219550 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:43.219786 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.219565 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:43.219786 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.219594 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret podName:486c6f74-a4fc-4bb1-bbed-6992239d6bf3 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:15.219582243 +0000 UTC m=+65.196720801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret") pod "global-pull-secret-syncer-hfnsm" (UID: "486c6f74-a4fc-4bb1-bbed-6992239d6bf3") : object "kube-system"/"original-pull-secret" not registered Jul 09 21:51:43.219786 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.219613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:15.219600074 +0000 UTC m=+65.196738632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 21:51:43.320176 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.320136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:43.320301 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.320278 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 21:51:43.320301 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.320293 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 21:51:43.320301 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.320302 2564 projected.go:196] Error preparing data for projected volume kube-api-access-bghfx for pod openshift-network-diagnostics/network-check-target-5hxbg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:43.320392 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.320341 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx podName:9db402c4-fa61-4970-8601-22fc9f433571 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:15.320329473 +0000 UTC m=+65.297468035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bghfx" (UniqueName: "kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx") pod "network-check-target-5hxbg" (UID: "9db402c4-fa61-4970-8601-22fc9f433571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 21:51:43.593194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.593108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:43.593324 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.593267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:43.593324 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.593275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:43.593324 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.593291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:43.593475 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.593348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hxbg" podUID="9db402c4-fa61-4970-8601-22fc9f433571" Jul 09 21:51:43.593475 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:43.593428 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:51:43.663805 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.663782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:43.768801 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:43.768779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:44.595828 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.595799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:44.596191 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:44.595916 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfnsm" podUID="486c6f74-a4fc-4bb1-bbed-6992239d6bf3" Jul 09 21:51:44.691336 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.691311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:44.744928 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.744906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:44.838901 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.838856 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeReady" Jul 09 21:51:44.838985 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.838935 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 21:51:44.880116 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.880096 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6lz77"] Jul 09 21:51:44.900296 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.900278 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jul 09 21:51:44.900405 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.900389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:44.902545 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.902523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 21:51:44.902633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.902546 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 21:51:44.902633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.902572 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k4f4\"" Jul 09 21:51:44.920381 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.920359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lz77"] Jul 09 21:51:44.920466 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.920400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jul 09 21:51:44.920516 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.920479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:44.922647 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.922630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 21:51:44.922776 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.922679 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 21:51:44.922842 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.922787 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 21:51:44.922898 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:44.922880 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vkm9l\"" Jul 09 21:51:45.003902 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.003870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:45.034009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.033985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c43fee24-f3ff-445c-8956-da86cc6ad959-config-volume\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.034109 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.034013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shswn\" (UniqueName: \"kubernetes.io/projected/c43fee24-f3ff-445c-8956-da86cc6ad959-kube-api-access-shswn\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.034109 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.034030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.034109 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.034063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c43fee24-f3ff-445c-8956-da86cc6ad959-tmp-dir\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.034289 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.034195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-cert\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.034289 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.034227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7ld7\" (UniqueName: \"kubernetes.io/projected/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-kube-api-access-v7ld7\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.058330 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.058312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:45.134485 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c43fee24-f3ff-445c-8956-da86cc6ad959-config-volume\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.134485 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shswn\" (UniqueName: \"kubernetes.io/projected/c43fee24-f3ff-445c-8956-da86cc6ad959-kube-api-access-shswn\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.134618 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.134618 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c43fee24-f3ff-445c-8956-da86cc6ad959-tmp-dir\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.134618 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:45.134596 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:51:45.134755 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:45.134661 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:45.634644385 +0000 UTC m=+35.611782945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:51:45.134755 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-cert\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.134755 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7ld7\" (UniqueName: \"kubernetes.io/projected/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-kube-api-access-v7ld7\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.134907 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c43fee24-f3ff-445c-8956-da86cc6ad959-tmp-dir\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.134970 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.134954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c43fee24-f3ff-445c-8956-da86cc6ad959-config-volume\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.139162 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.139131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-cert\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.142704 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.142673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shswn\" (UniqueName: \"kubernetes.io/projected/c43fee24-f3ff-445c-8956-da86cc6ad959-kube-api-access-shswn\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.143016 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.142990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7ld7\" (UniqueName: \"kubernetes.io/projected/00c89e2e-9acc-4456-9ac4-7691f0bc6db7-kube-api-access-v7ld7\") pod \"ingress-canary-vdjv9\" (UID: \"00c89e2e-9acc-4456-9ac4-7691f0bc6db7\") " pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.228121 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.228100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdjv9" Jul 09 21:51:45.415052 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.414996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdjv9"] Jul 09 21:51:45.418500 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:51:45.418471 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c89e2e_9acc_4456_9ac4_7691f0bc6db7.slice/crio-43bf6ee021131562527f33afe3f8367f8bc8b3d29726ba1bc43eb6eeae772008 WatchSource:0}: Error finding container 43bf6ee021131562527f33afe3f8367f8bc8b3d29726ba1bc43eb6eeae772008: Status 404 returned error can't find the container with id 43bf6ee021131562527f33afe3f8367f8bc8b3d29726ba1bc43eb6eeae772008 Jul 09 21:51:45.592922 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.592782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:51:45.593019 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.592832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:51:45.595369 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.595348 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 21:51:45.595369 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.595365 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdkql\"" Jul 09 21:51:45.596453 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.596438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7ms8\"" Jul 09 21:51:45.596934 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.596479 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 21:51:45.596934 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.596508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 21:51:45.638452 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.638432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:45.638569 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:45.638533 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:51:45.638627 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:45.638584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:46.638570003 +0000 UTC m=+36.615708574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:51:45.840504 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:45.840466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdjv9" event={"ID":"00c89e2e-9acc-4456-9ac4-7691f0bc6db7","Type":"ContainerStarted","Data":"43bf6ee021131562527f33afe3f8367f8bc8b3d29726ba1bc43eb6eeae772008"} Jul 09 21:51:46.593273 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:46.593238 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:51:46.596051 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:46.595952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 21:51:46.633966 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:46.633935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:46.644833 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:46.644814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:46.644974 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:46.644959 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:51:46.645040 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:46.645026 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:48.645006132 +0000 UTC m=+38.622144709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:51:48.659114 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:48.659087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:48.659443 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:48.659211 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:51:48.659443 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:48.659267 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:52.659252614 +0000 UTC m=+42.636391171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:51:49.496383 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.496354 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:49.550921 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.550897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:49.851527 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.851490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdjv9" event={"ID":"00c89e2e-9acc-4456-9ac4-7691f0bc6db7","Type":"ContainerStarted","Data":"a8218d6aa4b097bc6e0309452d9edfdf8988eb4437525d1faceed249357ef564"} Jul 09 21:51:49.854129 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.854108 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="adf07e14e42c93de505139e0dbb7402b9c3727b9c2ca65e296b7350bd5743f04" exitCode=0 Jul 09 21:51:49.854253 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.854141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"adf07e14e42c93de505139e0dbb7402b9c3727b9c2ca65e296b7350bd5743f04"} Jul 09 21:51:49.867451 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:49.867416 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vdjv9" podStartSLOduration=2.484239333 podStartE2EDuration="5.867404092s" totalImagesPullingTime="3.383164759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:49.866824793 +0000 UTC m=+39.843963371" watchObservedRunningTime="2026-07-09 21:51:49.867404092 +0000 UTC m=+39.844542671" Jul 09 21:51:50.858533 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:50.858508 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe1d2ecf-648d-4d17-87fb-d31725c89939" containerID="305a6cd14b8766ea95dbfc1589d9cf624b72ff9ba11a56e96373b650acb6481a" exitCode=0 Jul 09 21:51:50.858825 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:50.858590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerDied","Data":"305a6cd14b8766ea95dbfc1589d9cf624b72ff9ba11a56e96373b650acb6481a"} Jul 09 21:51:51.863772 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:51.863747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" event={"ID":"fe1d2ecf-648d-4d17-87fb-d31725c89939","Type":"ContainerStarted","Data":"414123d7d6ac23e3cdf8f58cf8289552c2df87b5f8cc504fe0e534becc354cee"} Jul 09 21:51:51.886164 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:51.886107 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b8lc2" podStartSLOduration=8.363692242 podStartE2EDuration="41.886094726s" totalImagesPullingTime="33.522402484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:51.884606845 +0000 UTC m=+41.861745424" watchObservedRunningTime="2026-07-09 21:51:51.886094726 +0000 UTC m=+41.863233304" Jul 09 21:51:52.005551 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:52.005525 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:52.106376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:52.106358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:52.685948 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:52.685925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:51:52.686063 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:52.686051 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:51:52.686110 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:51:52.686098 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:00.686085874 +0000 UTC m=+50.663224437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:51:54.569410 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:54.569376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:54.621105 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:54.621082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:56.106609 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:56.106573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:51:56.205100 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:51:56.205076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:00.738106 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:00.738075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:52:00.738537 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:00.738200 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:52:00.738537 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:00.738271 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:16.738258697 +0000 UTC m=+66.715397257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:52:00.963188 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:00.963141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:01.016164 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:01.016079 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:03.766946 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:03.766918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:03.822440 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:03.822414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:08.829353 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:08.829328 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcz29" Jul 09 21:52:08.976240 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:08.976205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:09.027634 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:09.027613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:15.232625 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.232588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:52:15.232625 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.232625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:52:15.235096 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.235077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 21:52:15.235186 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.235133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 21:52:15.242883 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:15.242867 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 21:52:15.242967 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:15.242929 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:53:19.242910655 +0000 UTC m=+129.220049225 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : secret "metrics-daemon-secret" not found Jul 09 21:52:15.245991 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.245967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/486c6f74-a4fc-4bb1-bbed-6992239d6bf3-original-pull-secret\") pod \"global-pull-secret-syncer-hfnsm\" (UID: \"486c6f74-a4fc-4bb1-bbed-6992239d6bf3\") " pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:52:15.333644 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.333612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:52:15.336307 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.336292 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 21:52:15.346078 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.346057 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 21:52:15.356994 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.356971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghfx\" (UniqueName: \"kubernetes.io/projected/9db402c4-fa61-4970-8601-22fc9f433571-kube-api-access-bghfx\") pod \"network-check-target-5hxbg\" (UID: \"9db402c4-fa61-4970-8601-22fc9f433571\") " pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:52:15.404702 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.404680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfnsm" Jul 09 21:52:15.514302 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.514241 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfnsm"] Jul 09 21:52:15.517762 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:52:15.517737 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486c6f74_a4fc_4bb1_bbed_6992239d6bf3.slice/crio-55554de66819bdacecc4e6b07a4440f0579ef2bbcc75e39aaba498f5661ae27d WatchSource:0}: Error finding container 55554de66819bdacecc4e6b07a4440f0579ef2bbcc75e39aaba498f5661ae27d: Status 404 returned error can't find the container with id 55554de66819bdacecc4e6b07a4440f0579ef2bbcc75e39aaba498f5661ae27d Jul 09 21:52:15.609057 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.609039 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7ms8\"" Jul 09 21:52:15.617904 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.617891 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:52:15.727193 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.727167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5hxbg"] Jul 09 21:52:15.730080 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:52:15.730059 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db402c4_fa61_4970_8601_22fc9f433571.slice/crio-682a8c8da6ef0c2bdc101fef4f50e6a7b702b0deeaa3dedda627a49e21df8018 WatchSource:0}: Error finding container 682a8c8da6ef0c2bdc101fef4f50e6a7b702b0deeaa3dedda627a49e21df8018: Status 404 returned error can't find the container with id 682a8c8da6ef0c2bdc101fef4f50e6a7b702b0deeaa3dedda627a49e21df8018 Jul 09 21:52:15.912224 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.912142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfnsm" event={"ID":"486c6f74-a4fc-4bb1-bbed-6992239d6bf3","Type":"ContainerStarted","Data":"55554de66819bdacecc4e6b07a4440f0579ef2bbcc75e39aaba498f5661ae27d"} Jul 09 21:52:15.914949 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:15.914930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5hxbg" event={"ID":"9db402c4-fa61-4970-8601-22fc9f433571","Type":"ContainerStarted","Data":"682a8c8da6ef0c2bdc101fef4f50e6a7b702b0deeaa3dedda627a49e21df8018"} Jul 09 21:52:16.743529 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:16.743060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:52:16.743529 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:16.743226 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:52:16.743529 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:16.743321 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:52:48.743301054 +0000 UTC m=+98.720439614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:52:19.803330 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:19.803298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:20.928944 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:20.928905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5hxbg" event={"ID":"9db402c4-fa61-4970-8601-22fc9f433571","Type":"ContainerStarted","Data":"c49f336b5ff289a4fbd3e27059f72fcc75b9ddae00bdb73ec1287838c25b8ee7"} Jul 09 21:52:20.929392 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:20.929050 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:52:20.930202 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:20.930179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfnsm" event={"ID":"486c6f74-a4fc-4bb1-bbed-6992239d6bf3","Type":"ContainerStarted","Data":"bf1082d81e9d1fa34b94cc36d774affd0e7eacae04830cc1a604348b7ce25aa0"} Jul 09 21:52:20.944629 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:20.944587 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5hxbg" podStartSLOduration=66.286643153 podStartE2EDuration="1m10.944575485s" totalImagesPullingTime="4.657932332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:52:20.944502613 +0000 UTC m=+70.921641194" watchObservedRunningTime="2026-07-09 21:52:20.944575485 +0000 UTC m=+70.921714091" Jul 09 21:52:20.957959 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:20.957917 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hfnsm" podStartSLOduration=66.08401782 podStartE2EDuration="1m10.957905422s" totalImagesPullingTime="4.873887602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:52:20.957626168 +0000 UTC m=+70.934764747" watchObservedRunningTime="2026-07-09 21:52:20.957905422 +0000 UTC m=+70.935043999" Jul 09 21:52:22.702830 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:22.702801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:22.760274 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:22.760240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:48.843492 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:48.843465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:52:48.843808 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:48.843567 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:52:48.843808 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:52:48.843620 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:53:52.843607012 +0000 UTC m=+162.820745569 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:52:51.934754 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:51.934727 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5hxbg" Jul 09 21:52:55.865850 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:55.865809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:52:55.917097 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:52:55.917072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:53:19.335132 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:53:19.335103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:53:19.335506 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:19.335208 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 21:53:19.335506 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:19.335256 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:21.335243423 +0000 UTC m=+251.312381980 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : secret "metrics-daemon-secret" not found Jul 09 21:53:47.910299 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:47.910230 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6lz77" podUID="c43fee24-f3ff-445c-8956-da86cc6ad959" Jul 09 21:53:48.109639 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:53:48.109619 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lz77" Jul 09 21:53:48.601978 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:48.601953 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:53:52.943977 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:53:52.943938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:53:52.944444 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:52.944034 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 21:53:52.944444 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:53:52.944090 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls podName:c43fee24-f3ff-445c-8956-da86cc6ad959 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:54.944076867 +0000 UTC m=+284.921215424 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls") pod "dns-default-6lz77" (UID: "c43fee24-f3ff-445c-8956-da86cc6ad959") : secret "dns-default-metrics-tls" not found Jul 09 21:54:00.594364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:54:00.594333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:54:48.569302 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:54:48.569265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:14.656574 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.656539 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k"] Jul 09 21:55:14.658330 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.658309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.664479 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.664457 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 21:55:14.664667 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.664652 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 21:55:14.664711 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.664678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 21:55:14.664923 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.664905 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 21:55:14.665910 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.665896 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nq6wj\"" Jul 09 21:55:14.682752 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.682731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k"] Jul 09 21:55:14.748778 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.748757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae611251-204d-4970-8e9d-d175cdd2f495-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.748874 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.748788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae611251-204d-4970-8e9d-d175cdd2f495-config\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.748874 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.748823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnl94\" (UniqueName: \"kubernetes.io/projected/ae611251-204d-4970-8e9d-d175cdd2f495-kube-api-access-xnl94\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.758909 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.758887 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl"] Jul 09 21:55:14.760684 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.760671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" Jul 09 21:55:14.762300 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.762273 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr"] Jul 09 21:55:14.763410 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.763391 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r5csk\"" Jul 09 21:55:14.764212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.764197 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:55:14.764320 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.764305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.766099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.766084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.767835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.767815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 21:55:14.767835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.767828 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5qvqt\"" Jul 09 21:55:14.767951 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.767838 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 21:55:14.767951 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.767857 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 21:55:14.767951 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.767870 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 21:55:14.768766 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.768752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 21:55:14.768820 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.768781 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 21:55:14.771203 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.771187 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hx9tw\"" Jul 09 21:55:14.771404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.771386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 21:55:14.774676 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.774657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 21:55:14.775478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.775461 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl"] Jul 09 21:55:14.780724 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.780706 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr"] Jul 09 21:55:14.781310 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.781291 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:55:14.849548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mck2q\" (UniqueName: \"kubernetes.io/projected/c67fc219-5133-48c4-acf9-902cd7d9385c-kube-api-access-mck2q\") pod \"network-check-source-989f8b8dc-sjsjl\" (UID: \"c67fc219-5133-48c4-acf9-902cd7d9385c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" Jul 09 21:55:14.849644 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849644 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849644 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl94\" (UniqueName: \"kubernetes.io/projected/ae611251-204d-4970-8e9d-d175cdd2f495-kube-api-access-xnl94\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae611251-204d-4970-8e9d-d175cdd2f495-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6pl\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.849797 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.850009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-548vf\" (UniqueName: \"kubernetes.io/projected/34ff5dac-867e-430f-8c75-b98753e385f1-kube-api-access-548vf\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.850009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.850009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.850009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34ff5dac-867e-430f-8c75-b98753e385f1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.850009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.849923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae611251-204d-4970-8e9d-d175cdd2f495-config\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.850364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.850348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae611251-204d-4970-8e9d-d175cdd2f495-config\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.851760 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.851741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae611251-204d-4970-8e9d-d175cdd2f495-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.857833 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.857816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnl94\" (UniqueName: \"kubernetes.io/projected/ae611251-204d-4970-8e9d-d175cdd2f495-kube-api-access-xnl94\") pod \"service-ca-operator-5d46d9ffd4-6cl9k\" (UID: \"ae611251-204d-4970-8e9d-d175cdd2f495\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.890875 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.890854 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:14.950075 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-548vf\" (UniqueName: \"kubernetes.io/projected/34ff5dac-867e-430f-8c75-b98753e385f1-kube-api-access-548vf\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.950161 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950161 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950161 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34ff5dac-867e-430f-8c75-b98753e385f1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.950161 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mck2q\" (UniqueName: \"kubernetes.io/projected/c67fc219-5133-48c4-acf9-902cd7d9385c-kube-api-access-mck2q\") pod \"network-check-source-989f8b8dc-sjsjl\" (UID: \"c67fc219-5133-48c4-acf9-902cd7d9385c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" Jul 09 21:55:14.950337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:14.950357 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6pl\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:14.950375 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d98978b5b-nvgm7: secret "image-registry-tls" not found Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:14.950425 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls podName:4e2342db-7a57-4989-ba3f-42a3c3982a6e nodeName:}" failed. No retries permitted until 2026-07-09 21:55:15.450407868 +0000 UTC m=+245.427546452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls") pod "image-registry-5d98978b5b-nvgm7" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e") : secret "image-registry-tls" not found Jul 09 21:55:14.950515 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:14.950486 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:14.950834 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:14.950540 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls podName:34ff5dac-867e-430f-8c75-b98753e385f1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:15.450526606 +0000 UTC m=+245.427665180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-82plr" (UID: "34ff5dac-867e-430f-8c75-b98753e385f1") : secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:14.950834 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950733 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950943 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.950943 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.950920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34ff5dac-867e-430f-8c75-b98753e385f1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.951101 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.951080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.952200 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.952178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.952570 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.952554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.958572 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.958550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.958645 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.958617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6pl\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:14.958914 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.958897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mck2q\" (UniqueName: \"kubernetes.io/projected/c67fc219-5133-48c4-acf9-902cd7d9385c-kube-api-access-mck2q\") pod \"network-check-source-989f8b8dc-sjsjl\" (UID: \"c67fc219-5133-48c4-acf9-902cd7d9385c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" Jul 09 21:55:14.959013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.958994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-548vf\" (UniqueName: \"kubernetes.io/projected/34ff5dac-867e-430f-8c75-b98753e385f1-kube-api-access-548vf\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:14.969889 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.969871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" Jul 09 21:55:14.990487 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:14.990465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:15.070588 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.070566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" Jul 09 21:55:15.080584 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.080557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k"] Jul 09 21:55:15.084668 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:15.084646 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae611251_204d_4970_8e9d_d175cdd2f495.slice/crio-5cfb97192fea3c7d3143d920017e16fc8b27d0b4a28fb433d789002c0be1bf91 WatchSource:0}: Error finding container 5cfb97192fea3c7d3143d920017e16fc8b27d0b4a28fb433d789002c0be1bf91: Status 404 returned error can't find the container with id 5cfb97192fea3c7d3143d920017e16fc8b27d0b4a28fb433d789002c0be1bf91 Jul 09 21:55:15.180191 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.180165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl"] Jul 09 21:55:15.182706 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:15.182685 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67fc219_5133_48c4_acf9_902cd7d9385c.slice/crio-f68051ff78eddbe1cb10bb1a09f1767c217ea22590b24c3dabe7ad6e8792a95b WatchSource:0}: Error finding container f68051ff78eddbe1cb10bb1a09f1767c217ea22590b24c3dabe7ad6e8792a95b: Status 404 returned error can't find the container with id f68051ff78eddbe1cb10bb1a09f1767c217ea22590b24c3dabe7ad6e8792a95b Jul 09 21:55:15.281790 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.281754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" event={"ID":"c67fc219-5133-48c4-acf9-902cd7d9385c","Type":"ContainerStarted","Data":"17226ef7d2bae8b6f507b11467e536cc648610ed98a47d9d8e436b43b7af1507"} Jul 09 21:55:15.281905 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.281816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" event={"ID":"c67fc219-5133-48c4-acf9-902cd7d9385c","Type":"ContainerStarted","Data":"f68051ff78eddbe1cb10bb1a09f1767c217ea22590b24c3dabe7ad6e8792a95b"} Jul 09 21:55:15.282879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.282855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" event={"ID":"ae611251-204d-4970-8e9d-d175cdd2f495","Type":"ContainerStarted","Data":"5cfb97192fea3c7d3143d920017e16fc8b27d0b4a28fb433d789002c0be1bf91"} Jul 09 21:55:15.296989 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.296949 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjsjl" podStartSLOduration=1.296936434 podStartE2EDuration="1.296936434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:15.296482528 +0000 UTC m=+245.273621106" watchObservedRunningTime="2026-07-09 21:55:15.296936434 +0000 UTC m=+245.274074991" Jul 09 21:55:15.455696 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.455671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:15.455793 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:15.455710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:15.455854 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:15.455794 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 21:55:15.455854 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:15.455803 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d98978b5b-nvgm7: secret "image-registry-tls" not found Jul 09 21:55:15.455854 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:15.455814 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:15.455854 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:15.455840 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls podName:4e2342db-7a57-4989-ba3f-42a3c3982a6e nodeName:}" failed. No retries permitted until 2026-07-09 21:55:16.45582949 +0000 UTC m=+246.432968048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls") pod "image-registry-5d98978b5b-nvgm7" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e") : secret "image-registry-tls" not found Jul 09 21:55:15.455995 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:15.455871 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls podName:34ff5dac-867e-430f-8c75-b98753e385f1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:16.455855069 +0000 UTC m=+246.432993639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-82plr" (UID: "34ff5dac-867e-430f-8c75-b98753e385f1") : secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:16.463086 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:16.463052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:16.463122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:16.463210 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:16.463258 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:16.463274 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d98978b5b-nvgm7: secret "image-registry-tls" not found Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:16.463289 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls podName:34ff5dac-867e-430f-8c75-b98753e385f1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:18.463267833 +0000 UTC m=+248.440406390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-82plr" (UID: "34ff5dac-867e-430f-8c75-b98753e385f1") : secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:16.463538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:16.463321 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls podName:4e2342db-7a57-4989-ba3f-42a3c3982a6e nodeName:}" failed. No retries permitted until 2026-07-09 21:55:18.463306581 +0000 UTC m=+248.440445150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls") pod "image-registry-5d98978b5b-nvgm7" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e") : secret "image-registry-tls" not found Jul 09 21:55:17.171757 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:17.171699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:17.221157 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:17.221128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:17.292292 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:17.292269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" event={"ID":"ae611251-204d-4970-8e9d-d175cdd2f495","Type":"ContainerStarted","Data":"0e015e6c4a8aeebf6bbf2789cfc459c5f25f2db1b723152ce8563cd8e6d25ab0"} Jul 09 21:55:17.307086 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:17.307044 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" podStartSLOduration=1.296984337 podStartE2EDuration="3.307031225s" totalImagesPullingTime="2.010046888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:17.306278961 +0000 UTC m=+247.283417538" watchObservedRunningTime="2026-07-09 21:55:17.307031225 +0000 UTC m=+247.284169804" Jul 09 21:55:17.660387 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:17.660358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:18.128477 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.128444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:18.226772 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.226748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:18.371633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.371609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:18.473238 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.473218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:18.478262 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.478242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:18.478367 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:18.478294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:18.478404 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:18.478369 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:18.478436 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:18.478413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls podName:34ff5dac-867e-430f-8c75-b98753e385f1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:22.478400265 +0000 UTC m=+252.455538826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-82plr" (UID: "34ff5dac-867e-430f-8c75-b98753e385f1") : secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:18.478473 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:18.478368 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 21:55:18.478473 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:18.478464 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d98978b5b-nvgm7: secret "image-registry-tls" not found Jul 09 21:55:18.478528 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:18.478511 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls podName:4e2342db-7a57-4989-ba3f-42a3c3982a6e nodeName:}" failed. No retries permitted until 2026-07-09 21:55:22.47849654 +0000 UTC m=+252.455635103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls") pod "image-registry-5d98978b5b-nvgm7" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e") : secret "image-registry-tls" not found Jul 09 21:55:19.481902 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.481873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:19.494974 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.494946 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d"] Jul 09 21:55:19.497090 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.497075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" Jul 09 21:55:19.499553 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.499530 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 21:55:19.499651 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.499605 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 21:55:19.500297 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.500285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nq9kr\"" Jul 09 21:55:19.507650 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.507626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d"] Jul 09 21:55:19.580253 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.580224 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:19.586209 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.586191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsbm\" (UniqueName: \"kubernetes.io/projected/455228f6-a497-4547-b7e6-304cc3d91bbf-kube-api-access-grsbm\") pod \"migrator-d57d58cc9-g5f7d\" (UID: \"455228f6-a497-4547-b7e6-304cc3d91bbf\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" Jul 09 21:55:19.680434 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.680400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:19.686411 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.686392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsbm\" (UniqueName: \"kubernetes.io/projected/455228f6-a497-4547-b7e6-304cc3d91bbf-kube-api-access-grsbm\") pod \"migrator-d57d58cc9-g5f7d\" (UID: \"455228f6-a497-4547-b7e6-304cc3d91bbf\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" Jul 09 21:55:19.693472 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.693452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsbm\" (UniqueName: \"kubernetes.io/projected/455228f6-a497-4547-b7e6-304cc3d91bbf-kube-api-access-grsbm\") pod \"migrator-d57d58cc9-g5f7d\" (UID: \"455228f6-a497-4547-b7e6-304cc3d91bbf\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" Jul 09 21:55:19.805817 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.805770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" Jul 09 21:55:19.845552 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.845520 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dm69s"] Jul 09 21:55:19.847602 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.847583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:19.850317 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.849978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 21:55:19.850317 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.850285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 21:55:19.850462 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.850331 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 21:55:19.850462 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.850360 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-78g6p\"" Jul 09 21:55:19.850462 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.850285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 21:55:19.861482 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.861412 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm69s"] Jul 09 21:55:19.882640 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.882612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:19.922330 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.922306 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d"] Jul 09 21:55:19.925527 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:19.925503 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455228f6_a497_4547_b7e6_304cc3d91bbf.slice/crio-4ed5266fa963d8bcc955c8bca602da1872574e8b22e08277dca16273980228ff WatchSource:0}: Error finding container 4ed5266fa963d8bcc955c8bca602da1872574e8b22e08277dca16273980228ff: Status 404 returned error can't find the container with id 4ed5266fa963d8bcc955c8bca602da1872574e8b22e08277dca16273980228ff Jul 09 21:55:19.940046 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.940021 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:19.965659 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.965640 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d8xlg"] Jul 09 21:55:19.967617 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.967596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:19.970179 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.970120 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 21:55:19.970179 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.970143 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 21:55:19.970339 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.970214 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 21:55:19.970339 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.970227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 21:55:19.970339 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.970214 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m9h9j\"" Jul 09 21:55:19.980005 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.979089 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d8xlg"] Jul 09 21:55:19.988087 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.988068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2615e29-1f3e-49b4-8026-867906f11c4d-data-volume\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:19.988185 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.988111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbshw\" (UniqueName: \"kubernetes.io/projected/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-api-access-lbshw\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:19.988185 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.988137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2615e29-1f3e-49b4-8026-867906f11c4d-crio-socket\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:19.988274 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.988247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:19.988313 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:19.988289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.005345 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.005311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:20.089301 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-cabundle\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.089301 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089420 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djdd\" (UniqueName: \"kubernetes.io/projected/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-kube-api-access-9djdd\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.089420 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089420 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2615e29-1f3e-49b4-8026-867906f11c4d-data-volume\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089420 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.089372 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 21:55:20.089420 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbshw\" (UniqueName: \"kubernetes.io/projected/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-api-access-lbshw\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.089424 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:20.589407531 +0000 UTC m=+250.566546088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : configmap "kube-rbac-proxy" not found Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2615e29-1f3e-49b4-8026-867906f11c4d-crio-socket\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.089504 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-key\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.089548 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:20.589536867 +0000 UTC m=+250.566675424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : secret "insights-runtime-extractor-tls" not found Jul 09 21:55:20.089623 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089611 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2615e29-1f3e-49b4-8026-867906f11c4d-crio-socket\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.089828 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.089616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2615e29-1f3e-49b4-8026-867906f11c4d-data-volume\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.096916 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.096898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbshw\" (UniqueName: \"kubernetes.io/projected/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-api-access-lbshw\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.124774 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.124751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:20.190301 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.190272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-key\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.190382 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.190307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-cabundle\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.190382 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.190346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9djdd\" (UniqueName: \"kubernetes.io/projected/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-kube-api-access-9djdd\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.190934 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.190906 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-cabundle\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.192365 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.192350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-signing-key\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.198470 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.198449 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djdd\" (UniqueName: \"kubernetes.io/projected/88213a0f-f17e-4a04-a32e-f1bc73edb5d4-kube-api-access-9djdd\") pod \"service-ca-758f599c5-d8xlg\" (UID: \"88213a0f-f17e-4a04-a32e-f1bc73edb5d4\") " pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.275829 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.275809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-d8xlg" Jul 09 21:55:20.302388 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.302367 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" event={"ID":"455228f6-a497-4547-b7e6-304cc3d91bbf","Type":"ContainerStarted","Data":"4ed5266fa963d8bcc955c8bca602da1872574e8b22e08277dca16273980228ff"} Jul 09 21:55:20.391492 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.391460 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-d8xlg"] Jul 09 21:55:20.393711 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:20.393678 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88213a0f_f17e_4a04_a32e_f1bc73edb5d4.slice/crio-289874ec21a4ebaa6e3f4fee170e10d9237a55a58eb0c2a5a5e6f0445d6ee47e WatchSource:0}: Error finding container 289874ec21a4ebaa6e3f4fee170e10d9237a55a58eb0c2a5a5e6f0445d6ee47e: Status 404 returned error can't find the container with id 289874ec21a4ebaa6e3f4fee170e10d9237a55a58eb0c2a5a5e6f0445d6ee47e Jul 09 21:55:20.594258 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.594224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.594640 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.594345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:20.594640 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.594361 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 21:55:20.594640 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.594409 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:21.594393127 +0000 UTC m=+251.571531684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : secret "insights-runtime-extractor-tls" not found Jul 09 21:55:20.594640 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.594448 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 21:55:20.594640 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:20.594493 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:21.594478997 +0000 UTC m=+251.571617570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : configmap "kube-rbac-proxy" not found Jul 09 21:55:20.854280 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:20.854233 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:21.307897 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.307862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" event={"ID":"455228f6-a497-4547-b7e6-304cc3d91bbf","Type":"ContainerStarted","Data":"514edccfcace9c5d50c34823558b4c874faae84b9def39bb7d8a89e6fdc00c85"} Jul 09 21:55:21.308025 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.307921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" event={"ID":"455228f6-a497-4547-b7e6-304cc3d91bbf","Type":"ContainerStarted","Data":"e36f4737a26f9379c964f1310469b7aa2506a4b968c17fef1450e2fac848a454"} Jul 09 21:55:21.309246 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.309220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-d8xlg" event={"ID":"88213a0f-f17e-4a04-a32e-f1bc73edb5d4","Type":"ContainerStarted","Data":"48f4220058726d7312cca019e290dd1025854429dc803b4b1332497cb518e3cc"} Jul 09 21:55:21.309342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.309257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-d8xlg" event={"ID":"88213a0f-f17e-4a04-a32e-f1bc73edb5d4","Type":"ContainerStarted","Data":"289874ec21a4ebaa6e3f4fee170e10d9237a55a58eb0c2a5a5e6f0445d6ee47e"} Jul 09 21:55:21.324406 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.324363 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g5f7d" podStartSLOduration=1.189321924 podStartE2EDuration="2.324348365s" totalImagesPullingTime="1.135026441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:21.324100638 +0000 UTC m=+251.301239218" watchObservedRunningTime="2026-07-09 21:55:21.324348365 +0000 UTC m=+251.301486943" Jul 09 21:55:21.339131 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.339096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-d8xlg" podStartSLOduration=2.339089501 podStartE2EDuration="2.339089501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:21.338262908 +0000 UTC m=+251.315401486" watchObservedRunningTime="2026-07-09 21:55:21.339089501 +0000 UTC m=+251.316228134" Jul 09 21:55:21.401845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.401794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:55:21.401954 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.401937 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 21:55:21.402009 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.401993 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs podName:2218784c-75ba-483b-9c4a-86e60c8a8be9 nodeName:}" failed. No retries permitted until 2026-07-09 21:57:23.401977178 +0000 UTC m=+373.379115737 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs") pod "network-metrics-daemon-zwvrl" (UID: "2218784c-75ba-483b-9c4a-86e60c8a8be9") : secret "metrics-daemon-secret" not found Jul 09 21:55:21.603460 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.603435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:21.603788 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:21.603518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:21.603788 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.603566 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 21:55:21.603788 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.603589 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 21:55:21.603788 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.603614 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:23.60360172 +0000 UTC m=+253.580740292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : secret "insights-runtime-extractor-tls" not found Jul 09 21:55:21.603788 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:21.603630 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:23.603622798 +0000 UTC m=+253.580761358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : configmap "kube-rbac-proxy" not found Jul 09 21:55:22.387177 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.387127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:22.431691 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.431668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tlch_b85ef31c-336f-44ff-b5d5-44f95a8cd592/dns-node-resolver/0.log" Jul 09 21:55:22.492835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.492805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:22.510952 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.510921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:22.511085 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.510970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:22.511085 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:22.511080 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 21:55:22.511210 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:22.511091 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d98978b5b-nvgm7: secret "image-registry-tls" not found Jul 09 21:55:22.511210 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:22.511132 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls podName:4e2342db-7a57-4989-ba3f-42a3c3982a6e nodeName:}" failed. No retries permitted until 2026-07-09 21:55:30.511120739 +0000 UTC m=+260.488259296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls") pod "image-registry-5d98978b5b-nvgm7" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e") : secret "image-registry-tls" not found Jul 09 21:55:22.511446 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:22.511413 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:22.511538 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:22.511477 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls podName:34ff5dac-867e-430f-8c75-b98753e385f1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:30.511459253 +0000 UTC m=+260.488597811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-82plr" (UID: "34ff5dac-867e-430f-8c75-b98753e385f1") : secret "cluster-monitoring-operator-tls" not found Jul 09 21:55:22.587614 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.587583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:22.688860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.688800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:22.788845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:22.788826 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:23.512725 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:23.512696 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:23.614528 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:23.614499 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:23.618653 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:23.618637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:23.618728 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:23.618713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:23.618790 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:23.618778 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 21:55:23.618823 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:23.618793 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 21:55:23.618855 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:23.618838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:27.618824086 +0000 UTC m=+257.595962658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : secret "insights-runtime-extractor-tls" not found Jul 09 21:55:23.618855 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:23.618852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:27.618847007 +0000 UTC m=+257.595985564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : configmap "kube-rbac-proxy" not found Jul 09 21:55:23.832416 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:23.832365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tzjzm_b53b3852-033a-461c-97a4-0d6c3a74159a/node-ca/0.log" Jul 09 21:55:24.088878 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.088806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:24.289384 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.289357 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:24.431991 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.431932 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdjv9_00c89e2e-9acc-4456-9ac4-7691f0bc6db7/serve-healthcheck-canary/0.log" Jul 09 21:55:24.689095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.689028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:24.831227 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.831209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g5f7d_455228f6-a497-4547-b7e6-304cc3d91bbf/migrator/0.log" Jul 09 21:55:24.888881 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:24.888862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:25.030949 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:25.030924 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g5f7d_455228f6-a497-4547-b7e6-304cc3d91bbf/graceful-termination/0.log" Jul 09 21:55:25.499379 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:25.499346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.106858 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.106833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.287796 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.287776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.355852 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.355828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.699343 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.699317 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.843991 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.843964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:26.944307 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:26.944284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:27.088436 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:27.088413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:27.647305 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:27.647281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:27.647633 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:27.647355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:27.647633 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:27.647424 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 21:55:27.647633 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:27.647443 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 21:55:27.647633 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:27.647468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:35.647456445 +0000 UTC m=+265.624595003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : configmap "kube-rbac-proxy" not found Jul 09 21:55:27.647633 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:27.647498 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls podName:e2615e29-1f3e-49b4-8026-867906f11c4d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:35.647481781 +0000 UTC m=+265.624620339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dm69s" (UID: "e2615e29-1f3e-49b4-8026-867906f11c4d") : secret "insights-runtime-extractor-tls" not found Jul 09 21:55:28.086647 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:28.086621 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:28.284735 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:28.284710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:28.682670 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:28.682649 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:28.884584 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:28.884564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:29.043210 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:29.043189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:29.287176 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:29.287136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:29.884435 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:29.884415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:30.485776 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.485757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:30.567802 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.567782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:30.567905 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.567850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:30.570059 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.570038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34ff5dac-867e-430f-8c75-b98753e385f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-82plr\" (UID: \"34ff5dac-867e-430f-8c75-b98753e385f1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:30.570182 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.570144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"image-registry-5d98978b5b-nvgm7\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:30.676838 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.676814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" Jul 09 21:55:30.682882 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.682868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:30.691281 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.691260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:30.822065 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.822036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr"] Jul 09 21:55:30.825029 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:30.825006 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ff5dac_867e_430f_8c75_b98753e385f1.slice/crio-55e1c348778ca686276fca63892bef6d5593e9138c93c542cefeeb5de638b7e8 WatchSource:0}: Error finding container 55e1c348778ca686276fca63892bef6d5593e9138c93c542cefeeb5de638b7e8: Status 404 returned error can't find the container with id 55e1c348778ca686276fca63892bef6d5593e9138c93c542cefeeb5de638b7e8 Jul 09 21:55:30.833720 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:30.833696 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:55:30.836385 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:30.836361 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2342db_7a57_4989_ba3f_42a3c3982a6e.slice/crio-7967af3bff73127f99cdfca3f4e4574e829ed1e78e997b009b64aa5b04329ffb WatchSource:0}: Error finding container 7967af3bff73127f99cdfca3f4e4574e829ed1e78e997b009b64aa5b04329ffb: Status 404 returned error can't find the container with id 7967af3bff73127f99cdfca3f4e4574e829ed1e78e997b009b64aa5b04329ffb Jul 09 21:55:31.082596 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.082529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:31.286590 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.286555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:31.338587 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.338519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" event={"ID":"4e2342db-7a57-4989-ba3f-42a3c3982a6e","Type":"ContainerStarted","Data":"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b"} Jul 09 21:55:31.338713 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.338591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" event={"ID":"4e2342db-7a57-4989-ba3f-42a3c3982a6e","Type":"ContainerStarted","Data":"7967af3bff73127f99cdfca3f4e4574e829ed1e78e997b009b64aa5b04329ffb"} Jul 09 21:55:31.338713 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.338649 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:55:31.339679 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.339657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" event={"ID":"34ff5dac-867e-430f-8c75-b98753e385f1","Type":"ContainerStarted","Data":"55e1c348778ca686276fca63892bef6d5593e9138c93c542cefeeb5de638b7e8"} Jul 09 21:55:31.357830 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.357789 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" podStartSLOduration=17.357767679 podStartE2EDuration="17.357767679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:31.355874587 +0000 UTC m=+261.333013167" watchObservedRunningTime="2026-07-09 21:55:31.357767679 +0000 UTC m=+261.334906260" Jul 09 21:55:31.360171 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.360133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:31.682411 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:31.682351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:32.298554 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:32.298494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:32.686187 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:32.686057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:32.887381 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:32.887349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:33.052580 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.052548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:33.151929 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.151895 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:33.252233 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.252208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:33.348864 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.348800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" event={"ID":"34ff5dac-867e-430f-8c75-b98753e385f1","Type":"ContainerStarted","Data":"f7c9b85c691eab059f7c3ea687bb6b91a09774efc09028d6766cffc7b0de944d"} Jul 09 21:55:33.367974 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.367934 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-82plr" podStartSLOduration=17.441778488 podStartE2EDuration="19.367921659s" totalImagesPullingTime="1.926143171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:33.366204601 +0000 UTC m=+263.343343178" watchObservedRunningTime="2026-07-09 21:55:33.367921659 +0000 UTC m=+263.345060236" Jul 09 21:55:33.716765 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:33.716741 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:34.778112 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:34.778086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:34.834228 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:34.834205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:35.702155 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.702130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:35.702273 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.702205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:35.702661 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.702645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2615e29-1f3e-49b4-8026-867906f11c4d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:35.704156 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.704134 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2615e29-1f3e-49b4-8026-867906f11c4d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm69s\" (UID: \"e2615e29-1f3e-49b4-8026-867906f11c4d\") " pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:35.759267 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.759248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm69s" Jul 09 21:55:35.874900 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:35.874870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm69s"] Jul 09 21:55:35.878001 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:35.877972 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2615e29_1f3e_49b4_8026_867906f11c4d.slice/crio-61fa4cdcd3d73838b3c1d62af9d4df48431358c0ce49a32bc0ffdb60131077b9 WatchSource:0}: Error finding container 61fa4cdcd3d73838b3c1d62af9d4df48431358c0ce49a32bc0ffdb60131077b9: Status 404 returned error can't find the container with id 61fa4cdcd3d73838b3c1d62af9d4df48431358c0ce49a32bc0ffdb60131077b9 Jul 09 21:55:36.360520 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:36.360446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm69s" event={"ID":"e2615e29-1f3e-49b4-8026-867906f11c4d","Type":"ContainerStarted","Data":"61fa4cdcd3d73838b3c1d62af9d4df48431358c0ce49a32bc0ffdb60131077b9"} Jul 09 21:55:39.968017 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:39.967983 2564 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-insights-runtime-exporter:latest" Jul 09 21:55:39.968339 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:39.968073 2564 kuberuntime_manager.go:1459] "Unhandled Error" err="container exporter start failed in pod insights-runtime-extractor-dm69s_openshift-insights(e2615e29-1f3e-49b4-8026-867906f11c4d): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 09 21:55:40.374426 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:40.374399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm69s" event={"ID":"e2615e29-1f3e-49b4-8026-867906f11c4d","Type":"ContainerStarted","Data":"a8941de92c23e9af0f0b062936576aa477828ea1ff2a5085138518feb0d93243"} Jul 09 21:55:40.540487 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:40.540454 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:40.638046 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:40.637980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:40.689416 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:40.689389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:40.858871 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:40.858827 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.228013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.227975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.282345 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.282319 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.678292 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.678208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.693431 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.693401 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh"] Jul 09 21:55:41.702442 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.702418 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:41.704839 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.704818 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-94kp9\"" Jul 09 21:55:41.706025 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.706003 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 21:55:41.710414 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.709429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh"] Jul 09 21:55:41.710414 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.710049 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:55:41.800053 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.797107 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.846211 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.846176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e9907ae-675a-4977-89aa-4d864c33fe80-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x5wdh\" (UID: \"4e9907ae-675a-4977-89aa-4d864c33fe80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:41.874946 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.874915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:41.947345 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.947278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e9907ae-675a-4977-89aa-4d864c33fe80-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x5wdh\" (UID: \"4e9907ae-675a-4977-89aa-4d864c33fe80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:41.949937 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.949912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e9907ae-675a-4977-89aa-4d864c33fe80-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x5wdh\" (UID: \"4e9907ae-675a-4977-89aa-4d864c33fe80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:41.972862 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:41.972840 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:42.013997 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.013970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:42.071972 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.071940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:42.174327 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.174297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:42.272771 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.272744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:42.430644 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.430605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:42.434625 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.434568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh"] Jul 09 21:55:42.436867 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:42.436846 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9907ae_675a_4977_89aa_4d864c33fe80.slice/crio-c9858e0fb655ddb446c3c12cc766d90664d3ca07d48d7a6268c79ff0784e0dc6 WatchSource:0}: Error finding container c9858e0fb655ddb446c3c12cc766d90664d3ca07d48d7a6268c79ff0784e0dc6: Status 404 returned error can't find the container with id c9858e0fb655ddb446c3c12cc766d90664d3ca07d48d7a6268c79ff0784e0dc6 Jul 09 21:55:42.456735 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:42.456705 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dm69s" podUID="e2615e29-1f3e-49b4-8026-867906f11c4d" Jul 09 21:55:42.811716 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:42.811692 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:43.386223 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:43.386187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" event={"ID":"4e9907ae-675a-4977-89aa-4d864c33fe80","Type":"ContainerStarted","Data":"c9858e0fb655ddb446c3c12cc766d90664d3ca07d48d7a6268c79ff0784e0dc6"} Jul 09 21:55:43.388048 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:43.388018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm69s" event={"ID":"e2615e29-1f3e-49b4-8026-867906f11c4d","Type":"ContainerStarted","Data":"ff12b592435a20be6ac2d4d2117469d5deb7b15079705ef1c04dc92aeaa139a7"} Jul 09 21:55:43.388743 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:43.388707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dm69s" podUID="e2615e29-1f3e-49b4-8026-867906f11c4d" Jul 09 21:55:44.047688 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:44.047663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:44.098419 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:44.098396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:44.392209 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:44.392143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" event={"ID":"4e9907ae-675a-4977-89aa-4d864c33fe80","Type":"ContainerStarted","Data":"734d38a2b8d99138e96e1cbaa3c0bee076f767629ab92ba2ed73cdb123864bc9"} Jul 09 21:55:44.392704 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:44.392683 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dm69s" podUID="e2615e29-1f3e-49b4-8026-867906f11c4d" Jul 09 21:55:44.420842 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:44.420802 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" podStartSLOduration=2.39184487 podStartE2EDuration="3.420785821s" totalImagesPullingTime="1.028940951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:44.420657842 +0000 UTC m=+274.397796423" watchObservedRunningTime="2026-07-09 21:55:44.420785821 +0000 UTC m=+274.397924399" Jul 09 21:55:45.394852 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:45.394823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:45.399250 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:45.399224 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x5wdh" Jul 09 21:55:46.238813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:46.238784 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:46.303949 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:46.303925 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:47.031202 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:47.031180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:49.410771 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:49.410742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:50.653562 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.653514 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:55:50.656519 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.656503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.658935 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.658913 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 21:55:50.659259 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.659244 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 21:55:50.659979 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.659964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 21:55:50.660157 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.660131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 21:55:50.660239 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.660192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 21:55:50.660239 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.660192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 21:55:50.660335 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.660298 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 21:55:50.660588 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.660574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rwbxc\"" Jul 09 21:55:50.667130 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.667111 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:55:50.804881 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.804859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xfs\" (UniqueName: \"kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.804971 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.804885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.804971 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.804904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.804971 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.804921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.805083 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.804986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.805083 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.805006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906244 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906333 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906333 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906441 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66xfs\" (UniqueName: \"kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906441 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906441 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.906943 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.907020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.907020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.906981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.908551 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.908532 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.908650 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.908635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.914070 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.914044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xfs\" (UniqueName: \"kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs\") pod \"console-7569f998d-p4pmp\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:50.965731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:50.965708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:55:51.086645 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:51.086618 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:55:51.089142 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:51.089121 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b20035_fba1_430f_9825_2d0c10d3c893.slice/crio-150fe16d78b2306c4aa18a4fb7a6451b52b2783d277272e2a33689e9183ca7c9 WatchSource:0}: Error finding container 150fe16d78b2306c4aa18a4fb7a6451b52b2783d277272e2a33689e9183ca7c9: Status 404 returned error can't find the container with id 150fe16d78b2306c4aa18a4fb7a6451b52b2783d277272e2a33689e9183ca7c9 Jul 09 21:55:51.110212 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:51.110188 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6lz77" podUID="c43fee24-f3ff-445c-8956-da86cc6ad959" Jul 09 21:55:51.412884 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:51.412859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569f998d-p4pmp" event={"ID":"83b20035-fba1-430f-9825-2d0c10d3c893","Type":"ContainerStarted","Data":"150fe16d78b2306c4aa18a4fb7a6451b52b2783d277272e2a33689e9183ca7c9"} Jul 09 21:55:51.412977 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:51.412870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lz77" Jul 09 21:55:51.715799 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:51.715760 2564 patch_prober.go:28] interesting pod/image-registry-5d98978b5b-nvgm7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 21:55:51.716170 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:51.715818 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 21:55:52.432274 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.432230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:52.608754 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.608694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:52.633899 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.633784 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7rsqn"] Jul 09 21:55:52.637720 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.637688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.640380 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.640358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 21:55:52.640733 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.640715 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7bmbr\"" Jul 09 21:55:52.641334 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.641316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 21:55:52.641545 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.641531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 21:55:52.641779 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.641764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 21:55:52.669175 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.666642 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd"] Jul 09 21:55:52.675266 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.674907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.676465 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.676407 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd"] Jul 09 21:55:52.677272 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.677244 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6m5b7\"" Jul 09 21:55:52.677682 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.677486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 21:55:52.678285 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.678085 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 21:55:52.679868 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.679850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 21:55:52.820097 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fnp\" (UniqueName: \"kubernetes.io/projected/95d80e6b-7df6-431c-a69e-f8af095fb8a5-kube-api-access-d6fnp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/38a1ffc7-f292-4192-9a9b-02681c10e7ec-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-metrics-client-ca\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwrkm\" (UniqueName: \"kubernetes.io/projected/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-api-access-lwrkm\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-sys\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-textfile\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.820521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-root\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.821182 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.820563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-wtmp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.851812 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.851762 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:55:52.855277 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.855235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:52.862061 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.862042 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 21:55:52.867536 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.867514 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:55:52.868466 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.868446 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:52.921493 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921493 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-textfile\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-root\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-wtmp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fnp\" (UniqueName: \"kubernetes.io/projected/95d80e6b-7df6-431c-a69e-f8af095fb8a5-kube-api-access-d6fnp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/38a1ffc7-f292-4192-9a9b-02681c10e7ec-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-metrics-client-ca\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwrkm\" (UniqueName: \"kubernetes.io/projected/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-api-access-lwrkm\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-sys\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.921903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.922291 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.921928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-root\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.922291 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-textfile\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.922519 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.922601 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/38a1ffc7-f292-4192-9a9b-02681c10e7ec-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.922654 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-wtmp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:52.922813 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d80e6b-7df6-431c-a69e-f8af095fb8a5-sys\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:52.922863 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls podName:95d80e6b-7df6-431c-a69e-f8af095fb8a5 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:53.42284626 +0000 UTC m=+283.399984832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls") pod "node-exporter-7rsqn" (UID: "95d80e6b-7df6-431c-a69e-f8af095fb8a5") : secret "node-exporter-tls" not found Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:52.922813 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:55:52.922900 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls podName:38a1ffc7-f292-4192-9a9b-02681c10e7ec nodeName:}" failed. No retries permitted until 2026-07-09 21:55:53.422888521 +0000 UTC m=+283.400027078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-zgxvd" (UID: "38a1ffc7-f292-4192-9a9b-02681c10e7ec") : secret "kube-state-metrics-tls" not found Jul 09 21:55:52.923032 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.922915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d80e6b-7df6-431c-a69e-f8af095fb8a5-metrics-client-ca\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.923525 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.923489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a1ffc7-f292-4192-9a9b-02681c10e7ec-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.927027 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.926972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.935412 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.934882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fnp\" (UniqueName: \"kubernetes.io/projected/95d80e6b-7df6-431c-a69e-f8af095fb8a5-kube-api-access-d6fnp\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.935662 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.935640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwrkm\" (UniqueName: \"kubernetes.io/projected/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-api-access-lwrkm\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:52.941465 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.941401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:52.968991 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:52.968969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.025973 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.025944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026276 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026276 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.026276 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.026215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfcfp\" (UniqueName: \"kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.070304 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.070269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.127624 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.127733 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.127733 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.127840 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.127889 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.127938 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfcfp\" (UniqueName: \"kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.128034 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.127997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.128731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.128467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.128731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.128642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.128945 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.128893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.129219 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.129181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.130655 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.130618 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.131071 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.131049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.137339 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.137317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfcfp\" (UniqueName: \"kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp\") pod \"console-677865b749-8cpkh\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.168025 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.167979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:55:53.170526 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.170506 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.273335 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.273299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.430271 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.430243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:53.430438 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.430288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:53.432808 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.432785 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95d80e6b-7df6-431c-a69e-f8af095fb8a5-node-exporter-tls\") pod \"node-exporter-7rsqn\" (UID: \"95d80e6b-7df6-431c-a69e-f8af095fb8a5\") " pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:53.432936 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.432854 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a1ffc7-f292-4192-9a9b-02681c10e7ec-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zgxvd\" (UID: \"38a1ffc7-f292-4192-9a9b-02681c10e7ec\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:53.552328 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.552260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rsqn" Jul 09 21:55:53.589179 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.589142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" Jul 09 21:55:53.642877 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.642851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.735214 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.735185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:53.804343 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:53.804278 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d80e6b_7df6_431c_a69e_f8af095fb8a5.slice/crio-4575c6c1e4c700bd01a8f8434a3d7e1226a871fd82c611d732eebea011103f3e WatchSource:0}: Error finding container 4575c6c1e4c700bd01a8f8434a3d7e1226a871fd82c611d732eebea011103f3e: Status 404 returned error can't find the container with id 4575c6c1e4c700bd01a8f8434a3d7e1226a871fd82c611d732eebea011103f3e Jul 09 21:55:53.942892 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.942792 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:55:53.945177 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:53.945127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a38517a_f18a_4f35_984c_a68d5d654201.slice/crio-619de45ef3187963501b93e3daaef7f15a86785689888a528841046d3df03258 WatchSource:0}: Error finding container 619de45ef3187963501b93e3daaef7f15a86785689888a528841046d3df03258: Status 404 returned error can't find the container with id 619de45ef3187963501b93e3daaef7f15a86785689888a528841046d3df03258 Jul 09 21:55:53.957687 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:53.957661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd"] Jul 09 21:55:53.963594 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:53.963553 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a1ffc7_f292_4192_9a9b_02681c10e7ec.slice/crio-f422d251f63b000a7bc758ec6ce3e533122488dab87f18ad7c16ea39f6dd261b WatchSource:0}: Error finding container f422d251f63b000a7bc758ec6ce3e533122488dab87f18ad7c16ea39f6dd261b: Status 404 returned error can't find the container with id f422d251f63b000a7bc758ec6ce3e533122488dab87f18ad7c16ea39f6dd261b Jul 09 21:55:54.107007 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.106935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:54.427205 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.427114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569f998d-p4pmp" event={"ID":"83b20035-fba1-430f-9825-2d0c10d3c893","Type":"ContainerStarted","Data":"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d"} Jul 09 21:55:54.429286 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.429141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677865b749-8cpkh" event={"ID":"9a38517a-f18a-4f35-984c-a68d5d654201","Type":"ContainerStarted","Data":"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110"} Jul 09 21:55:54.429286 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.429198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677865b749-8cpkh" event={"ID":"9a38517a-f18a-4f35-984c-a68d5d654201","Type":"ContainerStarted","Data":"619de45ef3187963501b93e3daaef7f15a86785689888a528841046d3df03258"} Jul 09 21:55:54.430807 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.430776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" event={"ID":"38a1ffc7-f292-4192-9a9b-02681c10e7ec","Type":"ContainerStarted","Data":"f422d251f63b000a7bc758ec6ce3e533122488dab87f18ad7c16ea39f6dd261b"} Jul 09 21:55:54.432098 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.432076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rsqn" event={"ID":"95d80e6b-7df6-431c-a69e-f8af095fb8a5","Type":"ContainerStarted","Data":"4575c6c1e4c700bd01a8f8434a3d7e1226a871fd82c611d732eebea011103f3e"} Jul 09 21:55:54.445753 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.445706 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7569f998d-p4pmp" podStartSLOduration=1.6873474160000002 podStartE2EDuration="4.445690251s" totalImagesPullingTime="2.758342835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:54.444401241 +0000 UTC m=+284.421539830" watchObservedRunningTime="2026-07-09 21:55:54.445690251 +0000 UTC m=+284.422828828" Jul 09 21:55:54.462733 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:54.462687 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677865b749-8cpkh" podStartSLOduration=2.462669656 podStartE2EDuration="2.462669656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:54.46117721 +0000 UTC m=+284.438315789" watchObservedRunningTime="2026-07-09 21:55:54.462669656 +0000 UTC m=+284.439808218" Jul 09 21:55:55.044285 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.044210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:55:55.046474 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.046454 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c43fee24-f3ff-445c-8956-da86cc6ad959-metrics-tls\") pod \"dns-default-6lz77\" (UID: \"c43fee24-f3ff-445c-8956-da86cc6ad959\") " pod="openshift-dns/dns-default-6lz77" Jul 09 21:55:55.315739 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.315685 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k4f4\"" Jul 09 21:55:55.324020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.323841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lz77" Jul 09 21:55:55.439191 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.439022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" event={"ID":"38a1ffc7-f292-4192-9a9b-02681c10e7ec","Type":"ContainerStarted","Data":"b9ce6968b164e382540d26c986bb13f89991119953ca32ac60b27ad276f141c5"} Jul 09 21:55:55.439191 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.439090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" event={"ID":"38a1ffc7-f292-4192-9a9b-02681c10e7ec","Type":"ContainerStarted","Data":"f894e7acd94809f10533116548951de3bcd1839f3b39605af1daeeb1e9705da5"} Jul 09 21:55:55.439191 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.439120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" event={"ID":"38a1ffc7-f292-4192-9a9b-02681c10e7ec","Type":"ContainerStarted","Data":"4830f0c7a85028198c40942413ef534d5666eb5ff9d305d94189ef601bd4c984"} Jul 09 21:55:55.441282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.441188 2564 generic.go:356] "Generic (PLEG): container finished" podID="95d80e6b-7df6-431c-a69e-f8af095fb8a5" containerID="9f05e7f3ae1e575cf5b3d62c8c744dfb51a9c9f73718f0059ea011e327bcba95" exitCode=0 Jul 09 21:55:55.441282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.441269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rsqn" event={"ID":"95d80e6b-7df6-431c-a69e-f8af095fb8a5","Type":"ContainerDied","Data":"9f05e7f3ae1e575cf5b3d62c8c744dfb51a9c9f73718f0059ea011e327bcba95"} Jul 09 21:55:55.457627 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.457544 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zgxvd" podStartSLOduration=2.233163855 podStartE2EDuration="3.45752833s" totalImagesPullingTime="1.224364475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:55.455955509 +0000 UTC m=+285.433094087" watchObservedRunningTime="2026-07-09 21:55:55.45752833 +0000 UTC m=+285.434666908" Jul 09 21:55:55.473844 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.473823 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lz77"] Jul 09 21:55:55.480300 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:55.480276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43fee24_f3ff_445c_8956_da86cc6ad959.slice/crio-02c701feeae4ef0e87683a030dbe28dcba93e668ba3a31e9e6f79a2f4d9c5984 WatchSource:0}: Error finding container 02c701feeae4ef0e87683a030dbe28dcba93e668ba3a31e9e6f79a2f4d9c5984: Status 404 returned error can't find the container with id 02c701feeae4ef0e87683a030dbe28dcba93e668ba3a31e9e6f79a2f4d9c5984 Jul 09 21:55:55.582071 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:55.582037 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:56.448654 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.448624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rsqn" event={"ID":"95d80e6b-7df6-431c-a69e-f8af095fb8a5","Type":"ContainerStarted","Data":"f08aa230950772ec06e586341a3d1d3b106e5b1b95c1f43f9b4a798796b55c53"} Jul 09 21:55:56.449009 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.448678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rsqn" event={"ID":"95d80e6b-7df6-431c-a69e-f8af095fb8a5","Type":"ContainerStarted","Data":"9c5be06f2e83d6ba1299e27eda94c01aea09f7b57b9827205228940819d8b962"} Jul 09 21:55:56.449963 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.449935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lz77" event={"ID":"c43fee24-f3ff-445c-8956-da86cc6ad959","Type":"ContainerStarted","Data":"02c701feeae4ef0e87683a030dbe28dcba93e668ba3a31e9e6f79a2f4d9c5984"} Jul 09 21:55:56.452456 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.452412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm69s" event={"ID":"e2615e29-1f3e-49b4-8026-867906f11c4d","Type":"ContainerStarted","Data":"ee64c3065e756eb54e3c17e6d7015555dc6f423a1c19fc1d80e16144ee40161f"} Jul 09 21:55:56.468727 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.468694 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7rsqn" podStartSLOduration=3.421222063 podStartE2EDuration="4.46868126s" totalImagesPullingTime="982.184866ms" totalInitContainerRuntime="65.274331ms" isStatefulPod=true podCreationTimestamp="2026-07-09 21:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:56.46749526 +0000 UTC m=+286.444633838" watchObservedRunningTime="2026-07-09 21:55:56.46868126 +0000 UTC m=+286.445819837" Jul 09 21:55:56.485658 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.485621 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dm69s" podStartSLOduration=17.080366235 podStartE2EDuration="37.485607467s" totalImagesPullingTime="20.405241232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:55:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 21:55:56.484699526 +0000 UTC m=+286.461838103" watchObservedRunningTime="2026-07-09 21:55:56.485607467 +0000 UTC m=+286.462746083" Jul 09 21:55:56.772803 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.772768 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:56.972836 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.972801 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67474fb59c-2dnpb"] Jul 09 21:55:56.976564 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.976531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:56.979312 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.979272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 21:55:56.980324 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.980302 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 21:55:56.980459 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.980378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 21:55:56.980540 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.980525 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 21:55:56.980637 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.980623 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1dhc4rlq3drbu\"" Jul 09 21:55:56.980804 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:56.980789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-m5lx6\"" Jul 09 21:55:57.006197 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.006173 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67474fb59c-2dnpb"] Jul 09 21:55:57.064322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064434 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74wd5\" (UniqueName: \"kubernetes.io/projected/464fb9ee-0a26-4362-ad99-c61542c73fc6-kube-api-access-74wd5\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064434 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-metrics-server-audit-profiles\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064434 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-client-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064574 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-client-certs\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064574 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/464fb9ee-0a26-4362-ad99-c61542c73fc6-audit-log\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.064574 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.064544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-tls\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165422 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165539 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74wd5\" (UniqueName: \"kubernetes.io/projected/464fb9ee-0a26-4362-ad99-c61542c73fc6-kube-api-access-74wd5\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165539 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-metrics-server-audit-profiles\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165665 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-client-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165733 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-client-certs\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165785 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/464fb9ee-0a26-4362-ad99-c61542c73fc6-audit-log\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.165844 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.165783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-tls\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.166244 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.166198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/464fb9ee-0a26-4362-ad99-c61542c73fc6-audit-log\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.166473 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.166455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.166564 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.166486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/464fb9ee-0a26-4362-ad99-c61542c73fc6-metrics-server-audit-profiles\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.168338 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.168315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-client-ca-bundle\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.168439 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.168368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-tls\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.168573 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.168551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/464fb9ee-0a26-4362-ad99-c61542c73fc6-secret-metrics-server-client-certs\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.173517 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.173497 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74wd5\" (UniqueName: \"kubernetes.io/projected/464fb9ee-0a26-4362-ad99-c61542c73fc6-kube-api-access-74wd5\") pod \"metrics-server-67474fb59c-2dnpb\" (UID: \"464fb9ee-0a26-4362-ad99-c61542c73fc6\") " pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.286421 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.286389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:55:57.414129 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.412795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:57.422953 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.422920 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v"] Jul 09 21:55:57.427440 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.427417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.429862 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.429839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 21:55:57.430078 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.430049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jpkcl\"" Jul 09 21:55:57.433552 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.433531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v"] Jul 09 21:55:57.441355 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.441333 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:55:57.451933 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.451905 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67474fb59c-2dnpb"] Jul 09 21:55:57.467467 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.467439 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:55:57.467956 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.467933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzz88\" (UniqueName: \"kubernetes.io/projected/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-kube-api-access-fzz88\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.468042 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.468010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.471505 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.471487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.483976 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.483958 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:55:57.501519 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.501483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:57.558595 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.558574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:57.568575 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz88\" (UniqueName: \"kubernetes.io/projected/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-kube-api-access-fzz88\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.568645 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnxc\" (UniqueName: \"kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568682 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.568727 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568791 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568830 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568862 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568903 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.568949 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.568921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.571089 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.571061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.575426 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.575407 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzz88\" (UniqueName: \"kubernetes.io/projected/98d7b4a2-b78b-44f8-9374-eeb8d8f27a60-kube-api-access-fzz88\") pod \"monitoring-plugin-d5dcff7cf-lt59v\" (UID: \"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.669736 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnxc\" (UniqueName: \"kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.669845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.669845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.669845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.669845 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670043 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670043 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.669884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670614 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.670593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670692 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.670597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670747 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.670700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.670809 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.670792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.671844 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.671823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.672048 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.672028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.678324 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.678308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnxc\" (UniqueName: \"kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc\") pod \"console-f9c746659-qvznz\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.763211 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.763177 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:55:57.781377 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.781356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:55:57.893799 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.893770 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v"] Jul 09 21:55:57.895725 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:57.895702 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d7b4a2_b78b_44f8_9374_eeb8d8f27a60.slice/crio-a5131034d08fcefe140d290a0d5ce88af7972b9d6fbcd69455136cca814e08d6 WatchSource:0}: Error finding container a5131034d08fcefe140d290a0d5ce88af7972b9d6fbcd69455136cca814e08d6: Status 404 returned error can't find the container with id a5131034d08fcefe140d290a0d5ce88af7972b9d6fbcd69455136cca814e08d6 Jul 09 21:55:57.909385 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:57.909366 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:55:57.911459 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:57.911434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a9780d_0a68_4da8_897f_3ceb2f6e71c0.slice/crio-72298a8b56a509ef18ab908cf685e080767d9bdaed54f68a673fbaa6b5789472 WatchSource:0}: Error finding container 72298a8b56a509ef18ab908cf685e080767d9bdaed54f68a673fbaa6b5789472: Status 404 returned error can't find the container with id 72298a8b56a509ef18ab908cf685e080767d9bdaed54f68a673fbaa6b5789472 Jul 09 21:55:58.465554 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.465516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" event={"ID":"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60","Type":"ContainerStarted","Data":"a5131034d08fcefe140d290a0d5ce88af7972b9d6fbcd69455136cca814e08d6"} Jul 09 21:55:58.467234 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.467198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9c746659-qvznz" event={"ID":"99a9780d-0a68-4da8-897f-3ceb2f6e71c0","Type":"ContainerStarted","Data":"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a"} Jul 09 21:55:58.467368 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.467256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9c746659-qvznz" event={"ID":"99a9780d-0a68-4da8-897f-3ceb2f6e71c0","Type":"ContainerStarted","Data":"72298a8b56a509ef18ab908cf685e080767d9bdaed54f68a673fbaa6b5789472"} Jul 09 21:55:58.468407 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.468384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" event={"ID":"464fb9ee-0a26-4362-ad99-c61542c73fc6","Type":"ContainerStarted","Data":"2d7c0a9141544c63bf61546f119c97aed7b219ff4b3616eaec8acdfc0c6448a1"} Jul 09 21:55:58.470114 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.470090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lz77" event={"ID":"c43fee24-f3ff-445c-8956-da86cc6ad959","Type":"ContainerStarted","Data":"53ec24f8311787822d6ac7ad279ab481fe138bad2f0fdff5cfe0ff2efb98cd7b"} Jul 09 21:55:58.470267 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.470131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lz77" event={"ID":"c43fee24-f3ff-445c-8956-da86cc6ad959","Type":"ContainerStarted","Data":"923b7a73c59df3d2d46f11f95a4a3f4efc44a857f00519f86b1375346f50ff9b"} Jul 09 21:55:58.470267 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.470218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6lz77" Jul 09 21:55:58.484940 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.484880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9c746659-qvznz" podStartSLOduration=1.484862925 podStartE2EDuration="1.484862925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:58.483810371 +0000 UTC m=+288.460948950" watchObservedRunningTime="2026-07-09 21:55:58.484862925 +0000 UTC m=+288.462001505" Jul 09 21:55:58.500993 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.500879 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6lz77" podStartSLOduration=252.623601543 podStartE2EDuration="4m14.50086372s" totalImagesPullingTime="1.877262177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:58.500265211 +0000 UTC m=+288.477403782" watchObservedRunningTime="2026-07-09 21:55:58.50086372 +0000 UTC m=+288.478002304" Jul 09 21:55:58.842698 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.842617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:55:58.849381 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.849353 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:55:58.854772 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.854749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.857669 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.857610 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 21:55:58.857669 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.857648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 21:55:58.857847 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.857811 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n4q82\"" Jul 09 21:55:58.858790 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.858389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 21:55:58.858790 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.858452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f1jm4aq9ngfn\"" Jul 09 21:55:58.858790 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.858506 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 21:55:58.859004 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.858976 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 21:55:58.859573 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.859243 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 21:55:58.859573 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.859354 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 21:55:58.859573 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.859434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 21:55:58.859788 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.859708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 21:55:58.859788 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.859752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 21:55:58.860255 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.860206 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 21:55:58.860360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.860209 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 21:55:58.860636 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.860584 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 21:55:58.861466 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.861442 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 21:55:58.872140 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.872112 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:55:58.878876 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.878981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.878981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.878981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.878981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.878983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88sp\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.879548 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.879532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980480 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88sp\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980757 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.980861 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.980978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.981079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.981376 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.981359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.982264 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.981755 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.982264 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.982004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.983248 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.982606 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.983330 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.983263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.984364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.983918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.984364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.984034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.984364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.984318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.984364 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.984350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.984841 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.984783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.985611 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.985586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.986368 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.986320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.986493 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.986459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.986493 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.986463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.986620 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.986603 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.987107 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.987081 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.987824 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.987808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.988329 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.988311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:58.991571 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:58.991552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88sp\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp\") pod \"prometheus-k8s-0\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:59.167302 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.167235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:55:59.475944 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.475903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" event={"ID":"464fb9ee-0a26-4362-ad99-c61542c73fc6","Type":"ContainerStarted","Data":"912af281e7ba954aa9def0bb0c8f36a2cf499d55fcf226213331aaa52a4dc022"} Jul 09 21:55:59.477765 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.477726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" event={"ID":"98d7b4a2-b78b-44f8-9374-eeb8d8f27a60","Type":"ContainerStarted","Data":"e83bb868beb914aa14e4586a238e27ea02b94f244e2f9c8389602ae632f06dc1"} Jul 09 21:55:59.479628 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.479610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:55:59.481927 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:55:59.481906 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5319a5fe_30f1_4885_bc8c_a971c1a76f2e.slice/crio-e84bef1d1059fafc1a598638f2abd4df1923be423a6aae66f2e0d85a853e465f WatchSource:0}: Error finding container e84bef1d1059fafc1a598638f2abd4df1923be423a6aae66f2e0d85a853e465f: Status 404 returned error can't find the container with id e84bef1d1059fafc1a598638f2abd4df1923be423a6aae66f2e0d85a853e465f Jul 09 21:55:59.495781 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.495743 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" podStartSLOduration=1.622205191 podStartE2EDuration="3.495728681s" totalImagesPullingTime="1.87352349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:59.494661035 +0000 UTC m=+289.471799637" watchObservedRunningTime="2026-07-09 21:55:59.495728681 +0000 UTC m=+289.472867260" Jul 09 21:55:59.508805 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:55:59.508768 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" podStartSLOduration=1.065811609 podStartE2EDuration="2.508756186s" totalImagesPullingTime="1.442944577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:59.508290125 +0000 UTC m=+289.485428703" watchObservedRunningTime="2026-07-09 21:55:59.508756186 +0000 UTC m=+289.485894763" Jul 09 21:56:00.482777 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:00.482739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"e84bef1d1059fafc1a598638f2abd4df1923be423a6aae66f2e0d85a853e465f"} Jul 09 21:56:00.483198 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:00.483112 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:56:00.487534 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:00.487504 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lt59v" Jul 09 21:56:00.966565 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:00.966536 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:56:01.488054 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:01.488027 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0" exitCode=0 Jul 09 21:56:01.488397 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:01.488113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0"} Jul 09 21:56:01.550201 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:01.550174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:01.649208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:01.649183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:01.714917 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:01.714896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:56:02.118328 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:02.118304 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:02.219977 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:02.219946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:02.321969 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:02.321938 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:02.421055 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:02.420978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:02.521340 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:02.521312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:03.168363 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:03.168331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:03.168537 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:03.168389 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:03.173579 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:03.173556 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:03.500626 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:03.500598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:03.595622 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:56:03.595588 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zwvrl" podUID="2218784c-75ba-483b-9c4a-86e60c8a8be9" Jul 09 21:56:04.355240 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:04.355204 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:04.422217 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:04.422190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:04.492880 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:04.492846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:04.594988 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:04.594954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:05.507555 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:05.507509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8"} Jul 09 21:56:05.507924 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:05.507581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78"} Jul 09 21:56:06.733669 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:06.733633 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerName="registry" containerID="cri-o://2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b" gracePeriod=30 Jul 09 21:56:06.981814 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:06.981785 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:56:07.046243 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046218 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046249 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046287 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046301 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046327 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046360 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046357 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h6pl\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046589 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046426 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046589 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046481 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates\") pod \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\" (UID: \"4e2342db-7a57-4989-ba3f-42a3c3982a6e\") " Jul 09 21:56:07.046692 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046675 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:07.046821 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.046800 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-trusted-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.047115 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.047067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:07.048602 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.048576 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:56:07.048677 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.048603 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:07.048835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.048812 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl" (OuterVolumeSpecName: "kube-api-access-6h6pl") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "kube-api-access-6h6pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:56:07.048872 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.048816 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:56:07.048975 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.048957 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:07.054636 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.054616 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e2342db-7a57-4989-ba3f-42a3c3982a6e" (UID: "4e2342db-7a57-4989-ba3f-42a3c3982a6e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 21:56:07.147958 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147906 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-certificates\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.147958 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147927 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-registry-tls\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.147958 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147941 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e2342db-7a57-4989-ba3f-42a3c3982a6e-ca-trust-extracted\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.147958 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147953 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-bound-sa-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.148123 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147965 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-installation-pull-secrets\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.148123 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147977 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h6pl\" (UniqueName: \"kubernetes.io/projected/4e2342db-7a57-4989-ba3f-42a3c3982a6e-kube-api-access-6h6pl\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.148123 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.147989 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e2342db-7a57-4989-ba3f-42a3c3982a6e-image-registry-private-configuration\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:07.516881 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.516853 2564 generic.go:356] "Generic (PLEG): container finished" podID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerID="2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b" exitCode=0 Jul 09 21:56:07.516981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.516901 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" Jul 09 21:56:07.516981 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.516938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" event={"ID":"4e2342db-7a57-4989-ba3f-42a3c3982a6e","Type":"ContainerDied","Data":"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b"} Jul 09 21:56:07.517063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.516982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d98978b5b-nvgm7" event={"ID":"4e2342db-7a57-4989-ba3f-42a3c3982a6e","Type":"ContainerDied","Data":"7967af3bff73127f99cdfca3f4e4574e829ed1e78e997b009b64aa5b04329ffb"} Jul 09 21:56:07.517063 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.517001 2564 scope.go:117] "RemoveContainer" containerID="2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b" Jul 09 21:56:07.520314 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.520292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff"} Jul 09 21:56:07.520427 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.520341 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d"} Jul 09 21:56:07.520427 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.520368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507"} Jul 09 21:56:07.520427 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.520398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerStarted","Data":"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503"} Jul 09 21:56:07.525120 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.525084 2564 scope.go:117] "RemoveContainer" containerID="2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b" Jul 09 21:56:07.525408 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:56:07.525385 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b\": container with ID starting with 2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b not found: ID does not exist" containerID="2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b" Jul 09 21:56:07.525476 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.525419 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b"} err="failed to get container status \"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b\": rpc error: code = NotFound desc = could not find container \"2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b\": container with ID starting with 2e16f14f730ea6aa4fb52885df5fdc462218b6988cb86290a2acbfae4eb60c9b not found: ID does not exist" Jul 09 21:56:07.554087 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.554054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.485976619 podStartE2EDuration="9.554041894s" totalImagesPullingTime="6.045960862s" totalInitContainerRuntime="22.104413ms" isStatefulPod=false podCreationTimestamp="2026-07-09 21:55:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:56:07.551425266 +0000 UTC m=+297.528563847" watchObservedRunningTime="2026-07-09 21:56:07.554041894 +0000 UTC m=+297.531180472" Jul 09 21:56:07.564337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.564318 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:56:07.568463 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.568445 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d98978b5b-nvgm7"] Jul 09 21:56:07.782137 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.782096 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:56:07.782137 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.782133 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:56:07.786575 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:07.786558 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:56:08.480419 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:08.480392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6lz77" Jul 09 21:56:08.529975 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:08.529952 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:56:08.580559 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:08.580530 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:56:08.599640 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:08.599615 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" path="/var/lib/kubelet/pods/4e2342db-7a57-4989-ba3f-42a3c3982a6e/volumes" Jul 09 21:56:09.167708 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:09.167683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:56:09.295879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:09.295806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:09.396395 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:09.396372 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:10.061713 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:10.061686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:10.121626 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:10.121601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:10.381237 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:10.381215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:56:10.381581 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:10.381350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 21:56:10.388459 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:10.388436 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 21:56:11.072416 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:11.072389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:11.139988 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:11.139961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:14.130161 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:14.130130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:14.854433 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:14.854393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:14.907047 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:14.907022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:16.395985 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:16.395955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:16.447550 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:16.447522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:17.287056 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:17.287012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:56:17.287282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:17.287091 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:56:17.592996 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:17.592916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:56:17.600934 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:17.600908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:17.656566 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:17.656536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:22.472001 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.471970 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7569f998d-p4pmp" podUID="83b20035-fba1-430f-9825-2d0c10d3c893" containerName="console" containerID="cri-o://3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d" gracePeriod=15 Jul 09 21:56:22.703962 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.703942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:56:22.757627 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757562 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.757753 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757638 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.757753 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757661 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.757874 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757751 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.757874 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757789 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.758020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.757994 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66xfs\" (UniqueName: \"kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs\") pod \"83b20035-fba1-430f-9825-2d0c10d3c893\" (UID: \"83b20035-fba1-430f-9825-2d0c10d3c893\") " Jul 09 21:56:22.758141 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758058 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config" (OuterVolumeSpecName: "console-config") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:22.758141 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758077 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:22.758283 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758184 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca" (OuterVolumeSpecName: "service-ca") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:22.758350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758320 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:22.758350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758333 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-oauth-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:22.758350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.758341 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83b20035-fba1-430f-9825-2d0c10d3c893-console-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:22.759814 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.759793 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:22.759898 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.759870 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs" (OuterVolumeSpecName: "kube-api-access-66xfs") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "kube-api-access-66xfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:56:22.759969 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.759954 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83b20035-fba1-430f-9825-2d0c10d3c893" (UID: "83b20035-fba1-430f-9825-2d0c10d3c893"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:22.858860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.858838 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66xfs\" (UniqueName: \"kubernetes.io/projected/83b20035-fba1-430f-9825-2d0c10d3c893-kube-api-access-66xfs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:22.858860 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.858856 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:22.858975 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:22.858866 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83b20035-fba1-430f-9825-2d0c10d3c893-console-oauth-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:23.580868 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.580837 2564 generic.go:356] "Generic (PLEG): container finished" podID="83b20035-fba1-430f-9825-2d0c10d3c893" containerID="3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d" exitCode=0 Jul 09 21:56:23.581197 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.580883 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569f998d-p4pmp" Jul 09 21:56:23.581197 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.580886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569f998d-p4pmp" event={"ID":"83b20035-fba1-430f-9825-2d0c10d3c893","Type":"ContainerDied","Data":"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d"} Jul 09 21:56:23.581197 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.580985 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569f998d-p4pmp" event={"ID":"83b20035-fba1-430f-9825-2d0c10d3c893","Type":"ContainerDied","Data":"150fe16d78b2306c4aa18a4fb7a6451b52b2783d277272e2a33689e9183ca7c9"} Jul 09 21:56:23.581197 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.581020 2564 scope.go:117] "RemoveContainer" containerID="3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d" Jul 09 21:56:23.589923 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.589905 2564 scope.go:117] "RemoveContainer" containerID="3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d" Jul 09 21:56:23.590271 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:56:23.590246 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d\": container with ID starting with 3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d not found: ID does not exist" containerID="3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d" Jul 09 21:56:23.590343 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.590278 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d"} err="failed to get container status \"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d\": rpc error: code = NotFound desc = could not find container \"3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d\": container with ID starting with 3dded6cfe5388e83cccf7307c0dd6e56727f8b0b0893df9579b1c5b55238ec4d not found: ID does not exist" Jul 09 21:56:23.610292 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.610273 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:56:23.622589 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:23.622568 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7569f998d-p4pmp"] Jul 09 21:56:24.316612 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:24.316586 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:24.370362 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:24.370331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:24.600742 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:24.600686 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b20035-fba1-430f-9825-2d0c10d3c893" path="/var/lib/kubelet/pods/83b20035-fba1-430f-9825-2d0c10d3c893/volumes" Jul 09 21:56:25.475196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:25.475162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:25.548006 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:25.547982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:28.503133 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:28.503103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:28.607064 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:28.607040 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:33.607326 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.607269 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-677865b749-8cpkh" podUID="9a38517a-f18a-4f35-984c-a68d5d654201" containerName="console" containerID="cri-o://f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110" gracePeriod=15 Jul 09 21:56:33.844587 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.844558 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:33.945768 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945707 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfcfp\" (UniqueName: \"kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945768 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945751 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945967 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945967 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945807 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945967 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945845 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945967 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945922 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.945967 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.945955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config\") pod \"9a38517a-f18a-4f35-984c-a68d5d654201\" (UID: \"9a38517a-f18a-4f35-984c-a68d5d654201\") " Jul 09 21:56:33.946305 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.946193 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:33.946367 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.946294 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config" (OuterVolumeSpecName: "console-config") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:33.946367 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.946247 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:33.946442 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.946371 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-oauth-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:33.946442 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.946400 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:56:33.947812 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.947782 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp" (OuterVolumeSpecName: "kube-api-access-bfcfp") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "kube-api-access-bfcfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:56:33.947906 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.947885 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:33.947951 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:33.947931 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a38517a-f18a-4f35-984c-a68d5d654201" (UID: "9a38517a-f18a-4f35-984c-a68d5d654201"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:56:34.047413 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047382 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfcfp\" (UniqueName: \"kubernetes.io/projected/9a38517a-f18a-4f35-984c-a68d5d654201-kube-api-access-bfcfp\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.047413 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047408 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-trusted-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.047413 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047417 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.047568 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047426 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-console-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.047568 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047434 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38517a-f18a-4f35-984c-a68d5d654201-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.047568 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.047443 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a38517a-f18a-4f35-984c-a68d5d654201-console-oauth-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:56:34.621011 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.620981 2564 generic.go:356] "Generic (PLEG): container finished" podID="9a38517a-f18a-4f35-984c-a68d5d654201" containerID="f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110" exitCode=0 Jul 09 21:56:34.621322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.621028 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677865b749-8cpkh" Jul 09 21:56:34.621322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.621033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677865b749-8cpkh" event={"ID":"9a38517a-f18a-4f35-984c-a68d5d654201","Type":"ContainerDied","Data":"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110"} Jul 09 21:56:34.621322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.621066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677865b749-8cpkh" event={"ID":"9a38517a-f18a-4f35-984c-a68d5d654201","Type":"ContainerDied","Data":"619de45ef3187963501b93e3daaef7f15a86785689888a528841046d3df03258"} Jul 09 21:56:34.621322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.621085 2564 scope.go:117] "RemoveContainer" containerID="f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110" Jul 09 21:56:34.629019 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.628999 2564 scope.go:117] "RemoveContainer" containerID="f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110" Jul 09 21:56:34.629326 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:56:34.629307 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110\": container with ID starting with f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110 not found: ID does not exist" containerID="f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110" Jul 09 21:56:34.629404 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.629337 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110"} err="failed to get container status \"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110\": rpc error: code = NotFound desc = could not find container \"f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110\": container with ID starting with f02a4451b1e766df1fcca05300e263fcc700a9f7cc4252540d69c183c6d68110 not found: ID does not exist" Jul 09 21:56:34.638350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.638330 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:56:34.644575 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:34.644553 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677865b749-8cpkh"] Jul 09 21:56:36.598192 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:36.598137 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a38517a-f18a-4f35-984c-a68d5d654201" path="/var/lib/kubelet/pods/9a38517a-f18a-4f35-984c-a68d5d654201/volumes" Jul 09 21:56:37.291337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:37.291308 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:56:37.295299 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:37.295277 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67474fb59c-2dnpb" Jul 09 21:56:39.302258 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:39.302227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:39.398721 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:39.398691 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:47.670240 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:47.670144 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae611251-204d-4970-8e9d-d175cdd2f495" containerID="0e015e6c4a8aeebf6bbf2789cfc459c5f25f2db1b723152ce8563cd8e6d25ab0" exitCode=0 Jul 09 21:56:47.670240 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:47.670219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" event={"ID":"ae611251-204d-4970-8e9d-d175cdd2f495","Type":"ContainerDied","Data":"0e015e6c4a8aeebf6bbf2789cfc459c5f25f2db1b723152ce8563cd8e6d25ab0"} Jul 09 21:56:47.670616 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:47.670544 2564 scope.go:117] "RemoveContainer" containerID="0e015e6c4a8aeebf6bbf2789cfc459c5f25f2db1b723152ce8563cd8e6d25ab0" Jul 09 21:56:48.676033 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:48.676001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6cl9k" event={"ID":"ae611251-204d-4970-8e9d-d175cdd2f495","Type":"ContainerStarted","Data":"c1767a7ec051f9f1357bcac994cff89ca70f303e71b9b01fc037acbdf171ee04"} Jul 09 21:56:51.769771 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:51.769741 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:57.716249 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:57.716218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:56:59.168188 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:59.168143 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:56:59.187584 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:59.187560 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:56:59.728321 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:56:59.728298 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:09.628243 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:09.628167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:09.685144 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:09.685115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:11.841204 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:11.841139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:12.113738 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:12.113645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:17.249946 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.249910 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:17.250982 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.250923 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="prometheus" containerID="cri-o://fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78" gracePeriod=600 Jul 09 21:57:17.251620 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.251590 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff" gracePeriod=600 Jul 09 21:57:17.251916 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.251852 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy" containerID="cri-o://393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d" gracePeriod=600 Jul 09 21:57:17.258024 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.252054 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-web" containerID="cri-o://9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507" gracePeriod=600 Jul 09 21:57:17.258024 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.252243 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="thanos-sidecar" containerID="cri-o://3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503" gracePeriod=600 Jul 09 21:57:17.258024 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.252269 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="config-reloader" containerID="cri-o://7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8" gracePeriod=600 Jul 09 21:57:17.788942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788911 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff" exitCode=0 Jul 09 21:57:17.788942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788937 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d" exitCode=0 Jul 09 21:57:17.788942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788942 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503" exitCode=0 Jul 09 21:57:17.788942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788948 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8" exitCode=0 Jul 09 21:57:17.788942 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788953 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78" exitCode=0 Jul 09 21:57:17.789409 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.788983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff"} Jul 09 21:57:17.789409 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.789051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d"} Jul 09 21:57:17.789409 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.789078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503"} Jul 09 21:57:17.789409 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.789111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8"} Jul 09 21:57:17.789409 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:17.789133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78"} Jul 09 21:57:18.513623 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.513600 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.587619 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587588 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587619 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587627 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587649 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587671 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587690 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587714 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587776 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587805 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587834 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.587879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587859 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587885 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587908 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587935 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.587971 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588007 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588037 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88sp\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588078 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588109 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588167 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca\") pod \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\" (UID: \"5319a5fe-30f1-4885-bc8c-a971c1a76f2e\") " Jul 09 21:57:18.588982 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.588909 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.589438 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.589116 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.589438 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.589220 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.589772 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.589603 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.589883 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.589863 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.590840 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.590802 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.591255 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.591229 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 21:57:18.591439 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.591406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:18.591906 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.591878 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out" (OuterVolumeSpecName: "config-out") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 21:57:18.592005 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.591902 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.592005 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.591979 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.592381 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.592348 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.594194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.592515 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.594194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.592553 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp" (OuterVolumeSpecName: "kube-api-access-j88sp") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "kube-api-access-j88sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:57:18.594194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.593910 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.594194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.593932 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config" (OuterVolumeSpecName: "config") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.594194 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.593999 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.594496 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.594410 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.595658 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.595529 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:57:18.605030 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.605006 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config" (OuterVolumeSpecName: "web-config") pod "5319a5fe-30f1-4885-bc8c-a971c1a76f2e" (UID: "5319a5fe-30f1-4885-bc8c-a971c1a76f2e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:18.689430 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689386 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-metrics-client-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689430 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689417 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-grpc-tls\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689430 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689431 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-db\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689444 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689456 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689469 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689482 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689494 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689508 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689519 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-web-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689531 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689545 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689558 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689569 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88sp\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-kube-api-access-j88sp\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689580 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689592 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-tls-assets\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689607 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-configmap-metrics-client-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689620 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689633 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.689703 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.689647 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5319a5fe-30f1-4885-bc8c-a971c1a76f2e-config-out\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:18.795400 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.795366 2564 generic.go:356] "Generic (PLEG): container finished" podID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerID="9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507" exitCode=0 Jul 09 21:57:18.795557 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.795425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507"} Jul 09 21:57:18.795557 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.795445 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.795557 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.795481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5319a5fe-30f1-4885-bc8c-a971c1a76f2e","Type":"ContainerDied","Data":"e84bef1d1059fafc1a598638f2abd4df1923be423a6aae66f2e0d85a853e465f"} Jul 09 21:57:18.795557 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.795513 2564 scope.go:117] "RemoveContainer" containerID="2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff" Jul 09 21:57:18.802985 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.802967 2564 scope.go:117] "RemoveContainer" containerID="393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d" Jul 09 21:57:18.810223 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.810205 2564 scope.go:117] "RemoveContainer" containerID="9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507" Jul 09 21:57:18.816629 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.816614 2564 scope.go:117] "RemoveContainer" containerID="3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503" Jul 09 21:57:18.819398 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.819372 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:18.825307 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.825283 2564 scope.go:117] "RemoveContainer" containerID="7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8" Jul 09 21:57:18.826928 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.826911 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:18.832199 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.832176 2564 scope.go:117] "RemoveContainer" containerID="fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78" Jul 09 21:57:18.839013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.838997 2564 scope.go:117] "RemoveContainer" containerID="2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0" Jul 09 21:57:18.845533 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.845518 2564 scope.go:117] "RemoveContainer" containerID="2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff" Jul 09 21:57:18.845793 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.845767 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff\": container with ID starting with 2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff not found: ID does not exist" containerID="2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff" Jul 09 21:57:18.845835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.845801 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff"} err="failed to get container status \"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff\": rpc error: code = NotFound desc = could not find container \"2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff\": container with ID starting with 2397b40a5b5d3dedf15fb81044d80359d7503aed51871b52c013c89b6c6c0fff not found: ID does not exist" Jul 09 21:57:18.845835 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.845822 2564 scope.go:117] "RemoveContainer" containerID="393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d" Jul 09 21:57:18.846025 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.846009 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d\": container with ID starting with 393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d not found: ID does not exist" containerID="393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d" Jul 09 21:57:18.846078 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846028 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d"} err="failed to get container status \"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d\": rpc error: code = NotFound desc = could not find container \"393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d\": container with ID starting with 393f181a9f214e59e1af696ae520cfe711306d8dd944a9a29dfb7d0f0b754a8d not found: ID does not exist" Jul 09 21:57:18.846078 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846041 2564 scope.go:117] "RemoveContainer" containerID="9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507" Jul 09 21:57:18.846257 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.846217 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507\": container with ID starting with 9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507 not found: ID does not exist" containerID="9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507" Jul 09 21:57:18.846257 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846243 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507"} err="failed to get container status \"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507\": rpc error: code = NotFound desc = could not find container \"9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507\": container with ID starting with 9e08f4161f09e9372f2b677d85dc6554686b417bf93eff440ad66b9f5c54b507 not found: ID does not exist" Jul 09 21:57:18.846329 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846263 2564 scope.go:117] "RemoveContainer" containerID="3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503" Jul 09 21:57:18.846487 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.846473 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503\": container with ID starting with 3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503 not found: ID does not exist" containerID="3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503" Jul 09 21:57:18.846534 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846490 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503"} err="failed to get container status \"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503\": rpc error: code = NotFound desc = could not find container \"3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503\": container with ID starting with 3dbd90c606bec12e542c967ac60172fe6582d9ff6fdb797c7888433b9a443503 not found: ID does not exist" Jul 09 21:57:18.846534 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846502 2564 scope.go:117] "RemoveContainer" containerID="7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8" Jul 09 21:57:18.846729 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.846713 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8\": container with ID starting with 7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8 not found: ID does not exist" containerID="7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8" Jul 09 21:57:18.846782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846739 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8"} err="failed to get container status \"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8\": rpc error: code = NotFound desc = could not find container \"7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8\": container with ID starting with 7085ba824c8a3123bba9d3ae12bee42a225948d835e54bcead254d75653d35b8 not found: ID does not exist" Jul 09 21:57:18.846782 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846762 2564 scope.go:117] "RemoveContainer" containerID="fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78" Jul 09 21:57:18.846952 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.846934 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78\": container with ID starting with fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78 not found: ID does not exist" containerID="fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78" Jul 09 21:57:18.846990 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846955 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78"} err="failed to get container status \"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78\": rpc error: code = NotFound desc = could not find container \"fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78\": container with ID starting with fef625e9c7ff098ce26ca3058950a67ea4b501276593689d0415118a4e955a78 not found: ID does not exist" Jul 09 21:57:18.846990 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.846968 2564 scope.go:117] "RemoveContainer" containerID="2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0" Jul 09 21:57:18.847143 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:18.847128 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0\": container with ID starting with 2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0 not found: ID does not exist" containerID="2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0" Jul 09 21:57:18.847204 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.847165 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0"} err="failed to get container status \"2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0\": rpc error: code = NotFound desc = could not find container \"2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0\": container with ID starting with 2f4fd15bce6f7e0909be68298875739dfb4a4b32013d484e2c0c834a1a0474f0 not found: ID does not exist" Jul 09 21:57:18.850824 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.850803 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:18.851077 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851065 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="config-reloader" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851079 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="config-reloader" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851090 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-web" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851097 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-web" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851105 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b20035-fba1-430f-9825-2d0c10d3c893" containerName="console" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851111 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b20035-fba1-430f-9825-2d0c10d3c893" containerName="console" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851119 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy" Jul 09 21:57:18.851125 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851124 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851131 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerName="registry" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851136 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerName="registry" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851142 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a38517a-f18a-4f35-984c-a68d5d654201" containerName="console" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851169 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a38517a-f18a-4f35-984c-a68d5d654201" containerName="console" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851176 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="prometheus" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851182 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="prometheus" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851187 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-thanos" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851192 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-thanos" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851200 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="thanos-sidecar" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851205 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="thanos-sidecar" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851212 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="init-config-reloader" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851217 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="init-config-reloader" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851268 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="config-reloader" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851274 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-web" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851281 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="thanos-sidecar" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851286 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851291 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="kube-rbac-proxy-thanos" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851297 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b20035-fba1-430f-9825-2d0c10d3c893" containerName="console" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851303 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" containerName="prometheus" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851309 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e2342db-7a57-4989-ba3f-42a3c3982a6e" containerName="registry" Jul 09 21:57:18.851350 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.851314 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a38517a-f18a-4f35-984c-a68d5d654201" containerName="console" Jul 09 21:57:18.855187 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.855168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.858916 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.858897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 21:57:18.859036 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.858916 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 21:57:18.859036 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.858942 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f1jm4aq9ngfn\"" Jul 09 21:57:18.859036 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.858950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 21:57:18.859322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.859305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 21:57:18.859671 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.859651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 21:57:18.859671 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.859664 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 21:57:18.859826 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.859662 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 21:57:18.860020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.860002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 21:57:18.860624 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.860486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n4q82\"" Jul 09 21:57:18.860624 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.860495 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 21:57:18.860624 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.860564 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 21:57:18.860813 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.860705 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 21:57:18.861748 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.861231 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 21:57:18.862719 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.862702 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 21:57:18.864836 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.864816 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 21:57:18.870781 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.870761 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:18.890448 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890605 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890605 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890605 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890605 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890605 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.890863 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.890946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.891016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.891041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.891072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbgz\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-kube-api-access-9tbgz\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.891212 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.891099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992253 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992253 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.992508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.993016 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.992988 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.993140 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.993115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.993705 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.993635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.993883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.993926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.993960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbgz\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-kube-api-access-9tbgz\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.994604 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.994231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.995595 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.995595 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.995755 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.995484 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.996345 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.996468 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.996553 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.996646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.996694 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.996679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/143bb82b-730d-4355-bf5d-f8e35760e2ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.997236 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.997217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.997721 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.997700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.998139 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.998120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/143bb82b-730d-4355-bf5d-f8e35760e2ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.998392 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.998372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/143bb82b-730d-4355-bf5d-f8e35760e2ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:18.998585 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:18.998569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:19.007911 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.007893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbgz\" (UniqueName: \"kubernetes.io/projected/143bb82b-730d-4355-bf5d-f8e35760e2ca-kube-api-access-9tbgz\") pod \"prometheus-k8s-0\" (UID: \"143bb82b-730d-4355-bf5d-f8e35760e2ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:19.165891 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.165803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:19.304710 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.304672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 21:57:19.308595 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:57:19.308571 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143bb82b_730d_4355_bf5d_f8e35760e2ca.slice/crio-49e85f7cb3727cb0f65fd0ee0a78746bd74a47d02dfdbd9c09524ffdef0beb7b WatchSource:0}: Error finding container 49e85f7cb3727cb0f65fd0ee0a78746bd74a47d02dfdbd9c09524ffdef0beb7b: Status 404 returned error can't find the container with id 49e85f7cb3727cb0f65fd0ee0a78746bd74a47d02dfdbd9c09524ffdef0beb7b Jul 09 21:57:19.801546 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.801505 2564 generic.go:356] "Generic (PLEG): container finished" podID="143bb82b-730d-4355-bf5d-f8e35760e2ca" containerID="e9448803ace16e31de7deb003916ee72f4ca0feca9bf569b5af261729fb6e7ec" exitCode=0 Jul 09 21:57:19.801953 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.801565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerDied","Data":"e9448803ace16e31de7deb003916ee72f4ca0feca9bf569b5af261729fb6e7ec"} Jul 09 21:57:19.801953 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:19.801667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"49e85f7cb3727cb0f65fd0ee0a78746bd74a47d02dfdbd9c09524ffdef0beb7b"} Jul 09 21:57:20.598025 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.597991 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5319a5fe-30f1-4885-bc8c-a971c1a76f2e" path="/var/lib/kubelet/pods/5319a5fe-30f1-4885-bc8c-a971c1a76f2e/volumes" Jul 09 21:57:20.729920 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.729887 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:57:20.732834 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.732813 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.742255 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.742232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:57:20.780104 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.780076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:20.808798 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"c0e4a2fc6516dea0fd484bfe009c695f3263fd771257ff13de5309dd1d4b2ac9"} Jul 09 21:57:20.809196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"b5d9ecae5b4032c478c1664bd9b838379a6f4ade530d91f730e605fc55aceb07"} Jul 09 21:57:20.809196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"85da2da75959458977baefd6577902051b1f4fc6486f1c584ed03a24a412ce76"} Jul 09 21:57:20.809196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"d214397e03ef834b0b9e31cd82b7fd39beb748b670f8a4c8bb901dca122d5386"} Jul 09 21:57:20.809196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808899 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"44955a9ea63df38cade90a4fbe5a9d13c0046018b416e1d14688be73bd18aa02"} Jul 09 21:57:20.809196 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.808923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"143bb82b-730d-4355-bf5d-f8e35760e2ca","Type":"ContainerStarted","Data":"fe968f97939a7cc698ca56d0ea3c67033a5aaf94b390df853c8ea9d228d14d39"} Jul 09 21:57:20.813750 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.813887 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7zk\" (UniqueName: \"kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.813887 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.813887 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.813887 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.814015 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.814015 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.813998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.836420 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.836360 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.81571015 podStartE2EDuration="2.836341715s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.631565ms" isStatefulPod=false podCreationTimestamp="2026-07-09 21:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:57:20.835343963 +0000 UTC m=+370.812482545" watchObservedRunningTime="2026-07-09 21:57:20.836341715 +0000 UTC m=+370.813480295" Jul 09 21:57:20.842083 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.842043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:20.915697 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.915697 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.915900 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.915900 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7zk\" (UniqueName: \"kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.915900 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.915900 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.916099 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.915980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.916440 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.916412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.916525 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.916479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.916682 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.916659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.916925 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.916903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.918473 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.918451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.918894 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.918872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:20.923749 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:20.923730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7zk\" (UniqueName: \"kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk\") pod \"console-76f67986c-zqsgk\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:21.042097 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:21.042044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:21.171069 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:21.171041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:57:21.173121 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:57:21.173092 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2294c8d_f968_49ca_9892_23f8f1e85caa.slice/crio-c39df92d208ca55e6f61fbdf5c490ad9bda046f63a8c4ed22b99952cb76cd7df WatchSource:0}: Error finding container c39df92d208ca55e6f61fbdf5c490ad9bda046f63a8c4ed22b99952cb76cd7df: Status 404 returned error can't find the container with id c39df92d208ca55e6f61fbdf5c490ad9bda046f63a8c4ed22b99952cb76cd7df Jul 09 21:57:21.814337 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:21.814297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f67986c-zqsgk" event={"ID":"c2294c8d-f968-49ca-9892-23f8f1e85caa","Type":"ContainerStarted","Data":"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780"} Jul 09 21:57:21.814712 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:21.814393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f67986c-zqsgk" event={"ID":"c2294c8d-f968-49ca-9892-23f8f1e85caa","Type":"ContainerStarted","Data":"c39df92d208ca55e6f61fbdf5c490ad9bda046f63a8c4ed22b99952cb76cd7df"} Jul 09 21:57:21.830965 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:21.830918 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f67986c-zqsgk" podStartSLOduration=1.830902161 podStartE2EDuration="1.830902161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:57:21.829753073 +0000 UTC m=+371.806891652" watchObservedRunningTime="2026-07-09 21:57:21.830902161 +0000 UTC m=+371.808040741" Jul 09 21:57:23.435651 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.435613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:57:23.437748 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.437730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2218784c-75ba-483b-9c4a-86e60c8a8be9-metrics-certs\") pod \"network-metrics-daemon-zwvrl\" (UID: \"2218784c-75ba-483b-9c4a-86e60c8a8be9\") " pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:57:23.595463 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.595439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdkql\"" Jul 09 21:57:23.603561 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.603544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwvrl" Jul 09 21:57:23.741032 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.741009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwvrl"] Jul 09 21:57:23.743303 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:57:23.743275 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2218784c_75ba_483b_9c4a_86e60c8a8be9.slice/crio-c2b2fd157eca949879dcc3f8f277ebed839b67972bf460fd6544c3dcf0182dc0 WatchSource:0}: Error finding container c2b2fd157eca949879dcc3f8f277ebed839b67972bf460fd6544c3dcf0182dc0: Status 404 returned error can't find the container with id c2b2fd157eca949879dcc3f8f277ebed839b67972bf460fd6544c3dcf0182dc0 Jul 09 21:57:23.745396 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.745377 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 21:57:23.822701 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:23.822676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwvrl" event={"ID":"2218784c-75ba-483b-9c4a-86e60c8a8be9","Type":"ContainerStarted","Data":"c2b2fd157eca949879dcc3f8f277ebed839b67972bf460fd6544c3dcf0182dc0"} Jul 09 21:57:24.166339 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:24.166308 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:57:25.833104 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:25.833069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwvrl" event={"ID":"2218784c-75ba-483b-9c4a-86e60c8a8be9","Type":"ContainerStarted","Data":"cf1fa7e1f1cc02bb168f7ed790dbdc510af146774bcb73cceddc0f98afad2b69"} Jul 09 21:57:25.833521 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:25.833134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwvrl" event={"ID":"2218784c-75ba-483b-9c4a-86e60c8a8be9","Type":"ContainerStarted","Data":"39a6d8a61e8f24c2d9fd930f52c2cd1188ece67bf295bdcac6686dbdd5de78c0"} Jul 09 21:57:25.851490 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:25.851441 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zwvrl" podStartSLOduration=374.767894231 podStartE2EDuration="6m15.85142562s" totalImagesPullingTime="1.083531389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:57:25.84836371 +0000 UTC m=+375.825502291" watchObservedRunningTime="2026-07-09 21:57:25.85142562 +0000 UTC m=+375.828564217" Jul 09 21:57:25.937720 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:25.937693 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:25.988414 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:25.988391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:31.042761 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:31.042725 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:31.043121 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:31.042791 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:31.047036 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:31.047014 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:31.862593 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:31.862566 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:57:31.912727 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:31.912703 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:57:32.035271 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:32.035240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:32.137102 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:32.137041 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:32.264879 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:32.264850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:57:56.932357 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:56.932301 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f9c746659-qvznz" podUID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" containerName="console" containerID="cri-o://9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a" gracePeriod=15 Jul 09 21:57:57.176394 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.176371 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:57:57.274121 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274098 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274254 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mnxc\" (UniqueName: \"kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274254 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274175 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274329 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274305 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274366 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274345 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274407 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274370 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274458 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config\") pod \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\" (UID: \"99a9780d-0a68-4da8-897f-3ceb2f6e71c0\") " Jul 09 21:57:57.274531 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274506 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:57.274786 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274699 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.274786 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274704 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:57.274920 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274723 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:57.274920 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.274874 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config" (OuterVolumeSpecName: "console-config") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:57:57.276225 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.276193 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc" (OuterVolumeSpecName: "kube-api-access-2mnxc") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "kube-api-access-2mnxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:57:57.276331 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.276265 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:57.276331 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.276284 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99a9780d-0a68-4da8-897f-3ceb2f6e71c0" (UID: "99a9780d-0a68-4da8-897f-3ceb2f6e71c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:57:57.374982 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.374961 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-oauth-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.374982 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.374980 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.375095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.374989 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.375095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.374997 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-console-oauth-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.375095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.375006 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mnxc\" (UniqueName: \"kubernetes.io/projected/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-kube-api-access-2mnxc\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.375095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.375015 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a9780d-0a68-4da8-897f-3ceb2f6e71c0-trusted-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:57:57.950755 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.950726 2564 generic.go:356] "Generic (PLEG): container finished" podID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" containerID="9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a" exitCode=0 Jul 09 21:57:57.951060 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.950771 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9c746659-qvznz" Jul 09 21:57:57.951060 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.950812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9c746659-qvznz" event={"ID":"99a9780d-0a68-4da8-897f-3ceb2f6e71c0","Type":"ContainerDied","Data":"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a"} Jul 09 21:57:57.951060 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.950862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9c746659-qvznz" event={"ID":"99a9780d-0a68-4da8-897f-3ceb2f6e71c0","Type":"ContainerDied","Data":"72298a8b56a509ef18ab908cf685e080767d9bdaed54f68a673fbaa6b5789472"} Jul 09 21:57:57.951060 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.950888 2564 scope.go:117] "RemoveContainer" containerID="9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a" Jul 09 21:57:57.959227 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.959213 2564 scope.go:117] "RemoveContainer" containerID="9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a" Jul 09 21:57:57.959480 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:57:57.959460 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a\": container with ID starting with 9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a not found: ID does not exist" containerID="9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a" Jul 09 21:57:57.959535 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.959492 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a"} err="failed to get container status \"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a\": rpc error: code = NotFound desc = could not find container \"9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a\": container with ID starting with 9e32b29b6279b88bcf3ac7eb292b2971b3fa4bbbe6d3ccc94459ed823328434a not found: ID does not exist" Jul 09 21:57:57.974208 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.974187 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:57:57.982423 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:57.982403 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9c746659-qvznz"] Jul 09 21:57:58.598056 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:57:58.598027 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" path="/var/lib/kubelet/pods/99a9780d-0a68-4da8-897f-3ceb2f6e71c0/volumes" Jul 09 21:58:19.166352 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:19.166324 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:58:19.181139 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:19.181116 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:58:20.053935 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:20.053908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 21:58:20.650282 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:20.650250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:20.837842 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:20.837814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:27.151285 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:27.151174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:27.230862 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:27.230810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:29.629098 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.629063 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 21:58:29.629558 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.629513 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" containerName="console" Jul 09 21:58:29.629558 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.629532 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" containerName="console" Jul 09 21:58:29.629670 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.629632 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a9780d-0a68-4da8-897f-3ceb2f6e71c0" containerName="console" Jul 09 21:58:29.633887 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.633866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.664534 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.664511 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 21:58:29.723534 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.723509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:29.784524 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784524 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784658 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784658 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphjb\" (UniqueName: \"kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784731 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.784809 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.784738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.809581 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.809560 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:29.885902 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.885849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.885902 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.885877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphjb\" (UniqueName: \"kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.885902 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.885897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.885929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.885975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.886005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886080 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.886032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886619 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.886596 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886727 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.886706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.886727 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.886718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.887092 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.887069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.888273 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.888245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.888449 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.888433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.896322 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.896296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphjb\" (UniqueName: \"kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb\") pod \"console-844cc55b6d-c9wdn\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:29.943274 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:29.943253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:30.074508 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:30.074481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 21:58:30.076844 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:58:30.076819 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e4d821_0f91_4ed9_8365_0908f90e46df.slice/crio-9ab2aa11738b1a0acf7825e0a6d975d2abecd054aa8f012cd1b11dd4b7b7424d WatchSource:0}: Error finding container 9ab2aa11738b1a0acf7825e0a6d975d2abecd054aa8f012cd1b11dd4b7b7424d: Status 404 returned error can't find the container with id 9ab2aa11738b1a0acf7825e0a6d975d2abecd054aa8f012cd1b11dd4b7b7424d Jul 09 21:58:31.078175 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:31.078130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844cc55b6d-c9wdn" event={"ID":"68e4d821-0f91-4ed9-8365-0908f90e46df","Type":"ContainerStarted","Data":"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182"} Jul 09 21:58:31.078530 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:31.078188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844cc55b6d-c9wdn" event={"ID":"68e4d821-0f91-4ed9-8365-0908f90e46df","Type":"ContainerStarted","Data":"9ab2aa11738b1a0acf7825e0a6d975d2abecd054aa8f012cd1b11dd4b7b7424d"} Jul 09 21:58:31.096224 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:31.096176 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844cc55b6d-c9wdn" podStartSLOduration=2.096161472 podStartE2EDuration="2.096161472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:58:31.094432557 +0000 UTC m=+441.071571162" watchObservedRunningTime="2026-07-09 21:58:31.096161472 +0000 UTC m=+441.073300060" Jul 09 21:58:39.096225 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:39.096104 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:39.169515 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:39.169452 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:39.943574 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:39.943535 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:39.943774 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:39.943616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:39.948285 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:39.948264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:40.116040 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:40.116016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 21:58:40.165140 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:40.165106 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:58:40.292961 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:40.292934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:40.392294 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:40.392246 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:40.464097 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:40.464072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:54.315126 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:54.315091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:58:54.416271 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:58:54.416234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:05.189478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.189412 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76f67986c-zqsgk" podUID="c2294c8d-f968-49ca-9892-23f8f1e85caa" containerName="console" containerID="cri-o://717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780" gracePeriod=15 Jul 09 21:59:05.424342 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.424315 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:59:05.456775 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.456748 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.456936 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.456922 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457005 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.456952 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457005 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.456995 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457106 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457021 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457106 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457062 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457238 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457100 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:59:05.457238 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457107 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7zk\" (UniqueName: \"kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk\") pod \"c2294c8d-f968-49ca-9892-23f8f1e85caa\" (UID: \"c2294c8d-f968-49ca-9892-23f8f1e85caa\") " Jul 09 21:59:05.457531 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457339 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config" (OuterVolumeSpecName: "console-config") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:59:05.457531 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457395 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.457669 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457574 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:59:05.457669 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.457627 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 21:59:05.459215 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.459185 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk" (OuterVolumeSpecName: "kube-api-access-hj7zk") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "kube-api-access-hj7zk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 21:59:05.459538 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.459512 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:59:05.459642 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.459622 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2294c8d-f968-49ca-9892-23f8f1e85caa" (UID: "c2294c8d-f968-49ca-9892-23f8f1e85caa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 21:59:05.558478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558436 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.558478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558474 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.558478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558484 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2294c8d-f968-49ca-9892-23f8f1e85caa-console-oauth-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.558478 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558494 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-trusted-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.558748 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558502 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2294c8d-f968-49ca-9892-23f8f1e85caa-oauth-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:05.558748 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:05.558510 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7zk\" (UniqueName: \"kubernetes.io/projected/c2294c8d-f968-49ca-9892-23f8f1e85caa-kube-api-access-hj7zk\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 21:59:06.210565 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.210528 2564 generic.go:356] "Generic (PLEG): container finished" podID="c2294c8d-f968-49ca-9892-23f8f1e85caa" containerID="717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780" exitCode=0 Jul 09 21:59:06.211013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.210575 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f67986c-zqsgk" Jul 09 21:59:06.211013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.210581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f67986c-zqsgk" event={"ID":"c2294c8d-f968-49ca-9892-23f8f1e85caa","Type":"ContainerDied","Data":"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780"} Jul 09 21:59:06.211013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.210619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f67986c-zqsgk" event={"ID":"c2294c8d-f968-49ca-9892-23f8f1e85caa","Type":"ContainerDied","Data":"c39df92d208ca55e6f61fbdf5c490ad9bda046f63a8c4ed22b99952cb76cd7df"} Jul 09 21:59:06.211013 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.210638 2564 scope.go:117] "RemoveContainer" containerID="717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780" Jul 09 21:59:06.219294 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.219272 2564 scope.go:117] "RemoveContainer" containerID="717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780" Jul 09 21:59:06.219568 ip-10-0-133-173 kubenswrapper[2564]: E0709 21:59:06.219548 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780\": container with ID starting with 717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780 not found: ID does not exist" containerID="717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780" Jul 09 21:59:06.219613 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.219576 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780"} err="failed to get container status \"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780\": rpc error: code = NotFound desc = could not find container \"717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780\": container with ID starting with 717d3c25f236f1cef7ee12021ec59ed937ac16fb1588d42dec406e8e69fdf780 not found: ID does not exist" Jul 09 21:59:06.231320 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.231297 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:59:06.235139 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.235121 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f67986c-zqsgk"] Jul 09 21:59:06.597456 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:06.597404 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2294c8d-f968-49ca-9892-23f8f1e85caa" path="/var/lib/kubelet/pods/c2294c8d-f968-49ca-9892-23f8f1e85caa/volumes" Jul 09 21:59:23.770095 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:23.770061 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:23.870020 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:23.869995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:49.405368 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:49.405314 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:50.437747 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:50.437716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:51.275563 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:51.275523 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:54.061449 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:54.061415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:54.159736 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:54.159702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:56.067444 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.067414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:56.162843 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.162813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:56.248276 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.248247 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h4wmh"] Jul 09 21:59:56.248546 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.248534 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2294c8d-f968-49ca-9892-23f8f1e85caa" containerName="console" Jul 09 21:59:56.248589 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.248547 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2294c8d-f968-49ca-9892-23f8f1e85caa" containerName="console" Jul 09 21:59:56.248623 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.248594 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2294c8d-f968-49ca-9892-23f8f1e85caa" containerName="console" Jul 09 21:59:56.251474 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.251460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.253876 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.253856 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 21:59:56.254817 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.254800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5jr7w\"" Jul 09 21:59:56.254884 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.254800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 21:59:56.262417 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.262398 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h4wmh"] Jul 09 21:59:56.430078 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.430003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzxc\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-kube-api-access-wnzxc\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.430238 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.430115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.531193 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.531142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.531379 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.531221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzxc\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-kube-api-access-wnzxc\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.542549 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.542521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzxc\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-kube-api-access-wnzxc\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.546463 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.546436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb41c102-4074-4492-a2ff-8e4f64f8e2d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h4wmh\" (UID: \"bb41c102-4074-4492-a2ff-8e4f64f8e2d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.569305 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.569278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 21:59:56.727215 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.727190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h4wmh"] Jul 09 21:59:56.728966 ip-10-0-133-173 kubenswrapper[2564]: W0709 21:59:56.728937 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb41c102_4074_4492_a2ff_8e4f64f8e2d0.slice/crio-7956ecc75b1992f22a681f37345c4e0090421abf51c5e53a48da64e62f865485 WatchSource:0}: Error finding container 7956ecc75b1992f22a681f37345c4e0090421abf51c5e53a48da64e62f865485: Status 404 returned error can't find the container with id 7956ecc75b1992f22a681f37345c4e0090421abf51c5e53a48da64e62f865485 Jul 09 21:59:56.772280 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.772260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:56.879379 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:56.879346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:57.393290 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:57.393247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" event={"ID":"bb41c102-4074-4492-a2ff-8e4f64f8e2d0","Type":"ContainerStarted","Data":"7956ecc75b1992f22a681f37345c4e0090421abf51c5e53a48da64e62f865485"} Jul 09 21:59:58.289285 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:58.289243 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 21:59:58.469602 ip-10-0-133-173 kubenswrapper[2564]: I0709 21:59:58.469566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:00.407809 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:00.407775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" event={"ID":"bb41c102-4074-4492-a2ff-8e4f64f8e2d0","Type":"ContainerStarted","Data":"43e318417894e819289f641f23a3eca5850db814c4e3f7ab762e5536c63576fd"} Jul 09 22:00:00.408248 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:00.407897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 22:00:00.423089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:00.423042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" podStartSLOduration=1.440663077 podStartE2EDuration="4.423027875s" totalImagesPullingTime="2.982364798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:00.422368517 +0000 UTC m=+530.399507099" watchObservedRunningTime="2026-07-09 22:00:00.423027875 +0000 UTC m=+530.400166455" Jul 09 22:00:01.120748 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:01.120717 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:01.221563 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:01.221527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:02.257622 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:02.257588 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:02.356756 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:02.356723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:03.875628 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:03.875557 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:03.976746 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:03.976704 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:06.414204 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:06.414169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h4wmh" Jul 09 22:00:06.677968 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:06.677889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:09.123907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:09.123875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:09.300471 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:09.300441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:18.459646 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:18.459612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:18.555302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:18.555275 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:24.865184 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:24.865122 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:24.921637 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:24.921599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:26.288981 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:26.288949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:26.788789 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:26.788740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:49.042100 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.042059 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:49.087108 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.087069 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms"] Jul 09 22:00:49.089362 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.089343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.093250 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 22:00:49.093415 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 22:00:49.093415 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zkh2d\"" Jul 09 22:00:49.093415 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 22:00:49.093553 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093500 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:00:49.093553 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.093521 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 22:00:49.102066 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.102035 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms"] Jul 09 22:00:49.124848 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.124811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:49.237499 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.237455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d9h\" (UniqueName: \"kubernetes.io/projected/53b77197-fc85-4e42-9f0c-3af0114a44f9-kube-api-access-w8d9h\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.237683 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.237541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.237683 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.237642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53b77197-fc85-4e42-9f0c-3af0114a44f9-manager-config\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.237683 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.237664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-metrics-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.338268 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.338137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53b77197-fc85-4e42-9f0c-3af0114a44f9-manager-config\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.338268 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.338212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-metrics-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.338268 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.338254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d9h\" (UniqueName: \"kubernetes.io/projected/53b77197-fc85-4e42-9f0c-3af0114a44f9-kube-api-access-w8d9h\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.338566 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.338297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.339622 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.339590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53b77197-fc85-4e42-9f0c-3af0114a44f9-manager-config\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.343814 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.343778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-metrics-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.345186 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.345135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b77197-fc85-4e42-9f0c-3af0114a44f9-cert\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.352396 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.352361 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d9h\" (UniqueName: \"kubernetes.io/projected/53b77197-fc85-4e42-9f0c-3af0114a44f9-kube-api-access-w8d9h\") pod \"lws-controller-manager-7b9cdbd59d-f4rms\" (UID: \"53b77197-fc85-4e42-9f0c-3af0114a44f9\") " pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.399260 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.399217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:49.555627 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.555600 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms"] Jul 09 22:00:49.558213 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:00:49.558185 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b77197_fc85_4e42_9f0c_3af0114a44f9.slice/crio-0b521ccbe22e118c948b3a263c43579c6784a01b2247e10f5daad6c9374caacf WatchSource:0}: Error finding container 0b521ccbe22e118c948b3a263c43579c6784a01b2247e10f5daad6c9374caacf: Status 404 returned error can't find the container with id 0b521ccbe22e118c948b3a263c43579c6784a01b2247e10f5daad6c9374caacf Jul 09 22:00:49.591381 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:49.591288 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" event={"ID":"53b77197-fc85-4e42-9f0c-3af0114a44f9","Type":"ContainerStarted","Data":"0b521ccbe22e118c948b3a263c43579c6784a01b2247e10f5daad6c9374caacf"} Jul 09 22:00:50.850314 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:50.850281 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:50.948600 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:50.948567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:51.475434 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.475391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:51.652411 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.652362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:51.755386 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.755293 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:51.798394 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.798358 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm"] Jul 09 22:00:51.800998 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.800976 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:51.803828 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.803800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 22:00:51.803976 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.803800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xz842\"" Jul 09 22:00:51.803976 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.803856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 22:00:51.804200 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.804182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 22:00:51.804200 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.804194 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 22:00:51.826268 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.826231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm"] Jul 09 22:00:51.961485 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.961442 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:51.963677 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.963646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:51.963852 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.963715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:51.963852 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.963761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvsrl\" (UniqueName: \"kubernetes.io/projected/9ff633bb-e66c-45d4-a389-9c8ca38c563b-kube-api-access-cvsrl\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:51.963852 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.963826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:51.963852 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:51.963849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.062837 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.062722 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:52.064987 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.064948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.065133 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.064999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.065133 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.065076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.065292 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.065124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.065292 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.065198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvsrl\" (UniqueName: \"kubernetes.io/projected/9ff633bb-e66c-45d4-a389-9c8ca38c563b-kube-api-access-cvsrl\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.065522 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.065493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.068233 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.068188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff633bb-e66c-45d4-a389-9c8ca38c563b-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.068606 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.068578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.068967 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.068949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff633bb-e66c-45d4-a389-9c8ca38c563b-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.075176 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.075116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvsrl\" (UniqueName: \"kubernetes.io/projected/9ff633bb-e66c-45d4-a389-9c8ca38c563b-kube-api-access-cvsrl\") pod \"opendatahub-operator-controller-manager-85dfbddc47-shbmm\" (UID: \"9ff633bb-e66c-45d4-a389-9c8ca38c563b\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.119093 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.119049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:52.165712 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.165502 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:52.253066 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.253029 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:52.297725 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.297644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm"] Jul 09 22:00:52.302685 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:00:52.302650 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff633bb_e66c_45d4_a389_9c8ca38c563b.slice/crio-b9473ae0b00e7ac65838e5f8a2f35b43493750fefe994df660bb3e50522e7353 WatchSource:0}: Error finding container b9473ae0b00e7ac65838e5f8a2f35b43493750fefe994df660bb3e50522e7353: Status 404 returned error can't find the container with id b9473ae0b00e7ac65838e5f8a2f35b43493750fefe994df660bb3e50522e7353 Jul 09 22:00:52.332167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.332086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:00:52.608411 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:52.608329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" event={"ID":"9ff633bb-e66c-45d4-a389-9c8ca38c563b","Type":"ContainerStarted","Data":"b9473ae0b00e7ac65838e5f8a2f35b43493750fefe994df660bb3e50522e7353"} Jul 09 22:00:53.616163 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:53.616106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" event={"ID":"53b77197-fc85-4e42-9f0c-3af0114a44f9","Type":"ContainerStarted","Data":"d93e7b69e6c26b280973f9d3a7227598396101662892bb59da8ea934da47b213"} Jul 09 22:00:53.616625 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:53.616213 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:00:53.641322 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:53.641275 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" podStartSLOduration=0.689044827 podStartE2EDuration="4.641257103s" totalImagesPullingTime="3.952212276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:53.638765106 +0000 UTC m=+583.615903702" watchObservedRunningTime="2026-07-09 22:00:53.641257103 +0000 UTC m=+583.618395683" Jul 09 22:00:56.632588 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:56.632549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" event={"ID":"9ff633bb-e66c-45d4-a389-9c8ca38c563b","Type":"ContainerStarted","Data":"91a71332f932ae9540e138d5172eb598a38f7ad955516875c281aafafecbccc0"} Jul 09 22:00:57.637889 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:57.637854 2564 generic.go:356] "Generic (PLEG): container finished" podID="9ff633bb-e66c-45d4-a389-9c8ca38c563b" containerID="91a71332f932ae9540e138d5172eb598a38f7ad955516875c281aafafecbccc0" exitCode=0 Jul 09 22:00:57.638300 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:57.637930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" event={"ID":"9ff633bb-e66c-45d4-a389-9c8ca38c563b","Type":"ContainerDied","Data":"91a71332f932ae9540e138d5172eb598a38f7ad955516875c281aafafecbccc0"} Jul 09 22:00:58.644525 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:58.644494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" event={"ID":"9ff633bb-e66c-45d4-a389-9c8ca38c563b","Type":"ContainerStarted","Data":"0614154b5c45c47261cbab8c021d6327d7457263d35633be9f7830c5e41060f4"} Jul 09 22:00:58.644842 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:58.644626 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:00:58.666240 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:00:58.666199 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" podStartSLOduration=2.595122899 podStartE2EDuration="7.666185283s" totalImagesPullingTime="3.924081673s" totalInitContainerRuntime="1.146980711s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:00:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:58.664233316 +0000 UTC m=+588.641371887" watchObservedRunningTime="2026-07-09 22:00:58.666185283 +0000 UTC m=+588.643323863" Jul 09 22:01:04.623734 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:04.623707 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b9cdbd59d-f4rms" Jul 09 22:01:07.464672 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:07.464632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:09.650048 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:09.650019 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-shbmm" Jul 09 22:01:10.407382 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:10.407357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:01:10.407557 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:10.407541 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:01:11.666861 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:11.666830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:18.473877 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:18.473844 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:22.128139 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.128087 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:22.292751 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.292726 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-c5thd"] Jul 09 22:01:22.295434 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.295415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.297847 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.297811 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 22:01:22.297957 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.297892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 22:01:22.297957 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.297912 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 22:01:22.298611 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.298592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 22:01:22.298736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.298699 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-98c2c\"" Jul 09 22:01:22.307489 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.307467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-c5thd"] Jul 09 22:01:22.392069 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.391994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87985b5b-6071-4413-81cb-55bb7e2defea-tmp\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.392069 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.392043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87985b5b-6071-4413-81cb-55bb7e2defea-tls-certs\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.392069 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.392065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plgrw\" (UniqueName: \"kubernetes.io/projected/87985b5b-6071-4413-81cb-55bb7e2defea-kube-api-access-plgrw\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.452027 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.451992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:22.492977 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.492947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87985b5b-6071-4413-81cb-55bb7e2defea-tmp\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.492977 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.492980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87985b5b-6071-4413-81cb-55bb7e2defea-tls-certs\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.493236 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.493002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plgrw\" (UniqueName: \"kubernetes.io/projected/87985b5b-6071-4413-81cb-55bb7e2defea-kube-api-access-plgrw\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.495308 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.495284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87985b5b-6071-4413-81cb-55bb7e2defea-tmp\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.495600 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.495581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87985b5b-6071-4413-81cb-55bb7e2defea-tls-certs\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.501938 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.501916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plgrw\" (UniqueName: \"kubernetes.io/projected/87985b5b-6071-4413-81cb-55bb7e2defea-kube-api-access-plgrw\") pod \"kube-auth-proxy-b6b884787-c5thd\" (UID: \"87985b5b-6071-4413-81cb-55bb7e2defea\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.518809 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.518789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:22.611013 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.610991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" Jul 09 22:01:22.750912 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.750844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-c5thd"] Jul 09 22:01:22.753847 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:01:22.753817 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87985b5b_6071_4413_81cb_55bb7e2defea.slice/crio-ed31e68fb10b7622371e9b945c7627f01df969701037150fd8924cb67210bdfd WatchSource:0}: Error finding container ed31e68fb10b7622371e9b945c7627f01df969701037150fd8924cb67210bdfd: Status 404 returned error can't find the container with id ed31e68fb10b7622371e9b945c7627f01df969701037150fd8924cb67210bdfd Jul 09 22:01:22.929952 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:22.929842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:23.017883 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:23.017858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:23.290476 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:23.290451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:23.479222 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:23.479133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:23.545170 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:23.545077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:23.750637 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:23.750600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" event={"ID":"87985b5b-6071-4413-81cb-55bb7e2defea","Type":"ContainerStarted","Data":"ed31e68fb10b7622371e9b945c7627f01df969701037150fd8924cb67210bdfd"} Jul 09 22:01:24.511710 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:24.511659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:26.765056 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:26.765024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" event={"ID":"87985b5b-6071-4413-81cb-55bb7e2defea","Type":"ContainerStarted","Data":"46620e6b67e4a0438628bada2786529efbc4323713c728133add243eebc1be2c"} Jul 09 22:01:26.781142 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:26.781086 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b6b884787-c5thd" podStartSLOduration=1.726507609 podStartE2EDuration="4.781069085s" totalImagesPullingTime="3.054561476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:26.780426588 +0000 UTC m=+616.757565171" watchObservedRunningTime="2026-07-09 22:01:26.781069085 +0000 UTC m=+616.758207665" Jul 09 22:01:28.648294 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:28.648261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:28.715044 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:28.715005 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:30.692775 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:30.692716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:30.784072 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:30.784044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:33.489345 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:33.489233 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:33.589045 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:33.588994 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:33.690778 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:33.690736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:33.975130 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:33.975091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:34.798599 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:34.798563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:34.980521 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:34.980490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:01:35.067606 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:01:35.067529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:14.033894 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:14.033843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:14.097486 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:14.097459 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:28.958969 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:28.958911 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8895854b-h8zks"] Jul 09 22:02:28.962185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:28.962144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:28.973545 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:28.973522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8895854b-h8zks"] Jul 09 22:02:29.007107 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.007084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:29.068183 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.068136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:29.105922 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.105901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-trusted-ca-bundle\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106022 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.105935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106022 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.105960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jf8s\" (UniqueName: \"kubernetes.io/projected/ad53f685-f918-45c9-b7dd-c6922c352f9d-kube-api-access-4jf8s\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106103 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.106029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-service-ca\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106103 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.106054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106103 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.106088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-oauth-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.106221 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.106115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-oauth-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206808 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206960 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jf8s\" (UniqueName: \"kubernetes.io/projected/ad53f685-f918-45c9-b7dd-c6922c352f9d-kube-api-access-4jf8s\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206960 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-service-ca\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206960 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206960 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-oauth-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.206960 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.206958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-oauth-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.207382 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.207010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-trusted-ca-bundle\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.207730 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.207692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-service-ca\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.207730 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.207712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.207901 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.207779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-oauth-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.208456 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.208430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad53f685-f918-45c9-b7dd-c6922c352f9d-trusted-ca-bundle\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.209314 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.209262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-serving-cert\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.209390 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.209358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad53f685-f918-45c9-b7dd-c6922c352f9d-console-oauth-config\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.214629 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.214609 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jf8s\" (UniqueName: \"kubernetes.io/projected/ad53f685-f918-45c9-b7dd-c6922c352f9d-kube-api-access-4jf8s\") pod \"console-7f8895854b-h8zks\" (UID: \"ad53f685-f918-45c9-b7dd-c6922c352f9d\") " pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.272366 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.272342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:29.423315 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:29.423232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8895854b-h8zks"] Jul 09 22:02:29.425569 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:02:29.425544 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad53f685_f918_45c9_b7dd_c6922c352f9d.slice/crio-5b5343e71dd26fc27796d337ca7aef701579abc163127c4e9878a0e60f0f3eed WatchSource:0}: Error finding container 5b5343e71dd26fc27796d337ca7aef701579abc163127c4e9878a0e60f0f3eed: Status 404 returned error can't find the container with id 5b5343e71dd26fc27796d337ca7aef701579abc163127c4e9878a0e60f0f3eed Jul 09 22:02:30.033185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:30.033124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8895854b-h8zks" event={"ID":"ad53f685-f918-45c9-b7dd-c6922c352f9d","Type":"ContainerStarted","Data":"3b95c051c072f1bd4927191019568c95c82f3ad124814f6ada8ebb6ee221430a"} Jul 09 22:02:30.033543 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:30.033211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8895854b-h8zks" event={"ID":"ad53f685-f918-45c9-b7dd-c6922c352f9d","Type":"ContainerStarted","Data":"5b5343e71dd26fc27796d337ca7aef701579abc163127c4e9878a0e60f0f3eed"} Jul 09 22:02:30.051723 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:30.051667 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8895854b-h8zks" podStartSLOduration=2.0516469920000002 podStartE2EDuration="2.051646992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:30.049717069 +0000 UTC m=+680.026855650" watchObservedRunningTime="2026-07-09 22:02:30.051646992 +0000 UTC m=+680.028785575" Jul 09 22:02:39.273280 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:39.273254 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:39.273624 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:39.273304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:39.277611 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:39.277588 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:40.079959 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:40.079933 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8895854b-h8zks" Jul 09 22:02:40.125745 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:40.125717 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 22:02:40.224553 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:40.224526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:40.325241 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:40.325217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:40.425975 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:40.425912 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:41.789607 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:41.789577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:44.472557 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:44.472521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:44.567664 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:44.567632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:46.638204 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:46.638141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:46.728964 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:46.728921 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:49.233832 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:49.233791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:49.343630 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:49.343538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:49.605719 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:49.605631 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:51.218307 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:51.218250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:52.428169 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:52.428112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:52.529454 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:52.529418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:54.234189 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:54.234134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:56.214530 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.214501 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm"] Jul 09 22:02:56.217934 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.217917 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.220389 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.220360 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 22:02:56.220389 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.220370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7cfx8\"" Jul 09 22:02:56.220548 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.220360 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 22:02:56.230370 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.230349 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm"] Jul 09 22:02:56.299740 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.299717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.299823 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.299747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmz87\" (UniqueName: \"kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.400769 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.400746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.400848 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.400776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmz87\" (UniqueName: \"kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.401066 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.401050 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.409183 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.409161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmz87\" (UniqueName: \"kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.528483 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.528433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:02:56.658943 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.658922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm"] Jul 09 22:02:56.661500 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:02:56.661473 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a35211_3f35_4dcc_b60e_3fa14e6d788d.slice/crio-2be4e8aa7b7d5c881eff6d302869179fe0acbc203a9e0ada74479993833daad2 WatchSource:0}: Error finding container 2be4e8aa7b7d5c881eff6d302869179fe0acbc203a9e0ada74479993833daad2: Status 404 returned error can't find the container with id 2be4e8aa7b7d5c881eff6d302869179fe0acbc203a9e0ada74479993833daad2 Jul 09 22:02:56.664015 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:56.663994 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:02:57.150757 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:57.150726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" event={"ID":"42a35211-3f35-4dcc-b60e-3fa14e6d788d","Type":"ContainerStarted","Data":"2be4e8aa7b7d5c881eff6d302869179fe0acbc203a9e0ada74479993833daad2"} Jul 09 22:02:57.402546 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:57.402481 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:02:57.502551 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:02:57.502528 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:02.813203 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:02.813165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:02.877417 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:02.877384 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:03.191809 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:03.191697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:03.292620 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:03.292589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:04.187380 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:04.187345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" event={"ID":"42a35211-3f35-4dcc-b60e-3fa14e6d788d","Type":"ContainerStarted","Data":"267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971"} Jul 09 22:03:04.187733 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:04.187427 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:04.212722 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:04.212678 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" podStartSLOduration=1.382619403 podStartE2EDuration="8.212663874s" totalImagesPullingTime="6.830044471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:04.210441568 +0000 UTC m=+714.187580147" watchObservedRunningTime="2026-07-09 22:03:04.212663874 +0000 UTC m=+714.189802454" Jul 09 22:03:05.149749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.149710 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-844cc55b6d-c9wdn" podUID="68e4d821-0f91-4ed9-8365-0908f90e46df" containerName="console" containerID="cri-o://96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182" gracePeriod=15 Jul 09 22:03:05.389680 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.389659 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 22:03:05.475886 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475865 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476039 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475893 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476039 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475918 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476039 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475935 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476039 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475958 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tphjb\" (UniqueName: \"kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476039 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.475988 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476332 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.476046 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert\") pod \"68e4d821-0f91-4ed9-8365-0908f90e46df\" (UID: \"68e4d821-0f91-4ed9-8365-0908f90e46df\") " Jul 09 22:03:05.476445 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.476400 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca" (OuterVolumeSpecName: "service-ca") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:03:05.476445 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.476419 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:03:05.476608 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.476487 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:03:05.476790 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.476766 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config" (OuterVolumeSpecName: "console-config") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:03:05.478052 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.478031 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:03:05.478135 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.478122 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:03:05.478349 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.478333 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb" (OuterVolumeSpecName: "kube-api-access-tphjb") pod "68e4d821-0f91-4ed9-8365-0908f90e46df" (UID: "68e4d821-0f91-4ed9-8365-0908f90e46df"). InnerVolumeSpecName "kube-api-access-tphjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:03:05.577233 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577213 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-console-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577233 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577233 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-trusted-ca-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577241 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577250 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-oauth-config\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577259 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tphjb\" (UniqueName: \"kubernetes.io/projected/68e4d821-0f91-4ed9-8365-0908f90e46df-kube-api-access-tphjb\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577268 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68e4d821-0f91-4ed9-8365-0908f90e46df-oauth-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:05.577351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:05.577276 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68e4d821-0f91-4ed9-8365-0908f90e46df-console-serving-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:06.199577 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.199546 2564 generic.go:356] "Generic (PLEG): container finished" podID="68e4d821-0f91-4ed9-8365-0908f90e46df" containerID="96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182" exitCode=0 Jul 09 22:03:06.199749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.199592 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844cc55b6d-c9wdn" Jul 09 22:03:06.199749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.199637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844cc55b6d-c9wdn" event={"ID":"68e4d821-0f91-4ed9-8365-0908f90e46df","Type":"ContainerDied","Data":"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182"} Jul 09 22:03:06.199749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.199686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844cc55b6d-c9wdn" event={"ID":"68e4d821-0f91-4ed9-8365-0908f90e46df","Type":"ContainerDied","Data":"9ab2aa11738b1a0acf7825e0a6d975d2abecd054aa8f012cd1b11dd4b7b7424d"} Jul 09 22:03:06.199749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.199714 2564 scope.go:117] "RemoveContainer" containerID="96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182" Jul 09 22:03:06.209092 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.209077 2564 scope.go:117] "RemoveContainer" containerID="96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182" Jul 09 22:03:06.209355 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:06.209339 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182\": container with ID starting with 96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182 not found: ID does not exist" containerID="96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182" Jul 09 22:03:06.209435 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.209360 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182"} err="failed to get container status \"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182\": rpc error: code = NotFound desc = could not find container \"96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182\": container with ID starting with 96fcea2ef8ef40f7ed6b22f35e1d340fb337bbb89ca92fc7813d642959264182 not found: ID does not exist" Jul 09 22:03:06.232807 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.232782 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 22:03:06.240078 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.240055 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:06.244478 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.244456 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844cc55b6d-c9wdn"] Jul 09 22:03:06.330192 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.330169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:06.430031 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.430009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:06.598930 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:06.598879 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68e4d821-0f91-4ed9-8365-0908f90e46df" path="/var/lib/kubelet/pods/68e4d821-0f91-4ed9-8365-0908f90e46df/volumes" Jul 09 22:03:10.340959 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:10.340931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:10.440940 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:10.440918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:15.195324 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:15.195298 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:16.543973 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.543929 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s"] Jul 09 22:03:16.544731 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.544707 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68e4d821-0f91-4ed9-8365-0908f90e46df" containerName="console" Jul 09 22:03:16.544835 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.544733 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68e4d821-0f91-4ed9-8365-0908f90e46df" containerName="console" Jul 09 22:03:16.544920 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.544908 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68e4d821-0f91-4ed9-8365-0908f90e46df" containerName="console" Jul 09 22:03:16.549784 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.549762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.562839 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.562816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s"] Jul 09 22:03:16.657620 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.657595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.657749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.657716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqn4x\" (UniqueName: \"kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.758828 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.758802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqn4x\" (UniqueName: \"kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.758918 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.758880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.759244 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.759228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.767420 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.767400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqn4x\" (UniqueName: \"kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x\") pod \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.859427 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.859374 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:16.888277 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.888254 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s"] Jul 09 22:03:16.898696 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.898377 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s"] Jul 09 22:03:16.912766 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.912745 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:16.916367 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.916348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:16.917736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.917717 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm"] Jul 09 22:03:16.917928 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.917906 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" containerName="manager" containerID="cri-o://267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971" gracePeriod=2 Jul 09 22:03:16.937904 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.937878 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm"] Jul 09 22:03:16.939119 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.939096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:16.962035 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.962010 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:16.962335 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.962320 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" containerName="manager" Jul 09 22:03:16.962335 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.962334 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" containerName="manager" Jul 09 22:03:16.962479 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.962383 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" containerName="manager" Jul 09 22:03:16.965261 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.965243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:16.994802 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:16.994775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:17.020931 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.020873 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.061622 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.061581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.061751 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.061660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn95p\" (UniqueName: \"kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.061751 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.061742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z669\" (UniqueName: \"kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.061863 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.061779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.103881 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.103857 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:17.156631 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.156606 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.158680 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.158655 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.163046 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.163102 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn95p\" (UniqueName: \"kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.163102 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z669\" (UniqueName: \"kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.163191 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.163407 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.163519 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.163500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.174890 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.174854 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn95p\" (UniqueName: \"kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p\") pod \"kuadrant-operator-controller-manager-55467d9f7-6m88h\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.174997 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.174924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z669\" (UniqueName: \"kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bfdvr\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.215399 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.215377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:17.227891 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.227871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:17.246106 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.246085 2564 generic.go:356] "Generic (PLEG): container finished" podID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" containerID="267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971" exitCode=0 Jul 09 22:03:17.246207 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.246126 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.246207 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.246159 2564 scope.go:117] "RemoveContainer" containerID="267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971" Jul 09 22:03:17.248533 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.248486 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.253914 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.253894 2564 scope.go:117] "RemoveContainer" containerID="267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971" Jul 09 22:03:17.254208 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.254179 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971\": container with ID starting with 267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971 not found: ID does not exist" containerID="267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971" Jul 09 22:03:17.254275 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.254211 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971"} err="failed to get container status \"267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971\": rpc error: code = NotFound desc = could not find container \"267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971\": container with ID starting with 267b9cb96b4cd3fc18f0e6e89262e61f7830c1f56a1c5487735de22408be7971 not found: ID does not exist" Jul 09 22:03:17.263350 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.263330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmz87\" (UniqueName: \"kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87\") pod \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " Jul 09 22:03:17.263475 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.263461 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume\") pod \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\" (UID: \"42a35211-3f35-4dcc-b60e-3fa14e6d788d\") " Jul 09 22:03:17.263828 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.263808 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42a35211-3f35-4dcc-b60e-3fa14e6d788d" (UID: "42a35211-3f35-4dcc-b60e-3fa14e6d788d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:03:17.265302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.265281 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87" (OuterVolumeSpecName: "kube-api-access-vmz87") pod "42a35211-3f35-4dcc-b60e-3fa14e6d788d" (UID: "42a35211-3f35-4dcc-b60e-3fa14e6d788d"). InnerVolumeSpecName "kube-api-access-vmz87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:03:17.302358 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.302334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:17.364105 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.364076 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a35211-3f35-4dcc-b60e-3fa14e6d788d-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:17.364105 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.364105 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmz87\" (UniqueName: \"kubernetes.io/projected/42a35211-3f35-4dcc-b60e-3fa14e6d788d-kube-api-access-vmz87\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:17.400345 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.400319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:17.403246 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:03:17.403209 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233b43fd_b05d_4240_9112_b77020ed88be.slice/crio-e4e1a225625483f77c3b9c1b367c15ff44f3ffd6bc0d01ed10191f3c3896f5a0 WatchSource:0}: Error finding container e4e1a225625483f77c3b9c1b367c15ff44f3ffd6bc0d01ed10191f3c3896f5a0: Status 404 returned error can't find the container with id e4e1a225625483f77c3b9c1b367c15ff44f3ffd6bc0d01ed10191f3c3896f5a0 Jul 09 22:03:17.469525 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:17.469505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:17.477300 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:03:17.477266 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfd5dce_89d5_434b_ae94_f5ac46059d88.slice/crio-c90d413960f486d89efb8ba608f2698b565bd38f497d289dc06a3309376e054c WatchSource:0}: Error finding container c90d413960f486d89efb8ba608f2698b565bd38f497d289dc06a3309376e054c: Status 404 returned error can't find the container with id c90d413960f486d89efb8ba608f2698b565bd38f497d289dc06a3309376e054c Jul 09 22:03:17.556241 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.556215 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:17.847895 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.847861 2564 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 09 22:03:17.847895 ip-10-0-133-173 kubenswrapper[2564]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dz62s_kuadrant-system_6bc8af26-55ff-492e-80f4-49e2d145e167_0(217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dz62s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be" Netns:"/var/run/netns/63cfea83-9586-4fb4-9c0d-a3a7078dee99" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-dz62s;K8S_POD_INFRA_CONTAINER_ID=217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be;K8S_POD_UID=6bc8af26-55ff-492e-80f4-49e2d145e167" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s/6bc8af26-55ff-492e-80f4-49e2d145e167:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s 217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s 217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-dz62s" not found Jul 09 22:03:17.847895 ip-10-0-133-173 kubenswrapper[2564]: ' Jul 09 22:03:17.847895 ip-10-0-133-173 kubenswrapper[2564]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 09 22:03:17.847895 ip-10-0-133-173 kubenswrapper[2564]: > Jul 09 22:03:17.848089 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:17.847924 2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 09 22:03:17.848089 ip-10-0-133-173 kubenswrapper[2564]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dz62s_kuadrant-system_6bc8af26-55ff-492e-80f4-49e2d145e167_0(217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dz62s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be" Netns:"/var/run/netns/63cfea83-9586-4fb4-9c0d-a3a7078dee99" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-dz62s;K8S_POD_INFRA_CONTAINER_ID=217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be;K8S_POD_UID=6bc8af26-55ff-492e-80f4-49e2d145e167" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s/6bc8af26-55ff-492e-80f4-49e2d145e167:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s 217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s 217dce4748ffd1b0f5270f1a24c868c78ad95ddd068bef7c7e31e38558d7e1be network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-dz62s" not found Jul 09 22:03:17.848089 ip-10-0-133-173 kubenswrapper[2564]: ' Jul 09 22:03:17.848089 ip-10-0-133-173 kubenswrapper[2564]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 09 22:03:17.848089 ip-10-0-133-173 kubenswrapper[2564]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:18.251661 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.251626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" event={"ID":"233b43fd-b05d-4240-9112-b77020ed88be","Type":"ContainerStarted","Data":"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c"} Jul 09 22:03:18.251832 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.251685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" event={"ID":"233b43fd-b05d-4240-9112-b77020ed88be","Type":"ContainerStarted","Data":"e4e1a225625483f77c3b9c1b367c15ff44f3ffd6bc0d01ed10191f3c3896f5a0"} Jul 09 22:03:18.251832 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.251719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:18.254016 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.253989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:18.254016 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.253997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" event={"ID":"4cfd5dce-89d5-434b-ae94-f5ac46059d88","Type":"ContainerStarted","Data":"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0"} Jul 09 22:03:18.254212 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:18.254021 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:18.254212 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.254039 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" event={"ID":"4cfd5dce-89d5-434b-ae94-f5ac46059d88","Type":"ContainerStarted","Data":"c90d413960f486d89efb8ba608f2698b565bd38f497d289dc06a3309376e054c"} Jul 09 22:03:18.254212 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.254072 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:18.261749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.261733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:18.282540 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.282493 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" podStartSLOduration=2.282475623 podStartE2EDuration="2.282475623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:18.28048539 +0000 UTC m=+728.257623968" watchObservedRunningTime="2026-07-09 22:03:18.282475623 +0000 UTC m=+728.259614205" Jul 09 22:03:18.311638 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.311595 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" podStartSLOduration=2.311584028 podStartE2EDuration="2.311584028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:18.310261799 +0000 UTC m=+728.287400379" watchObservedRunningTime="2026-07-09 22:03:18.311584028 +0000 UTC m=+728.288722609" Jul 09 22:03:18.312830 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:18.312804 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q7thm\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q7thm" Jul 09 22:03:18.314962 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:18.314938 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="6bc8af26-55ff-492e-80f4-49e2d145e167" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:18.372370 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.372347 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume\") pod \"6bc8af26-55ff-492e-80f4-49e2d145e167\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " Jul 09 22:03:18.372465 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.372408 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqn4x\" (UniqueName: \"kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x\") pod \"6bc8af26-55ff-492e-80f4-49e2d145e167\" (UID: \"6bc8af26-55ff-492e-80f4-49e2d145e167\") " Jul 09 22:03:18.372600 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.372574 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6bc8af26-55ff-492e-80f4-49e2d145e167" (UID: "6bc8af26-55ff-492e-80f4-49e2d145e167"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:03:18.374421 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.374399 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x" (OuterVolumeSpecName: "kube-api-access-wqn4x") pod "6bc8af26-55ff-492e-80f4-49e2d145e167" (UID: "6bc8af26-55ff-492e-80f4-49e2d145e167"). InnerVolumeSpecName "kube-api-access-wqn4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:03:18.473957 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.473920 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bc8af26-55ff-492e-80f4-49e2d145e167-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:18.473957 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.473950 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqn4x\" (UniqueName: \"kubernetes.io/projected/6bc8af26-55ff-492e-80f4-49e2d145e167-kube-api-access-wqn4x\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:18.599312 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.599238 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a35211-3f35-4dcc-b60e-3fa14e6d788d" path="/var/lib/kubelet/pods/42a35211-3f35-4dcc-b60e-3fa14e6d788d/volumes" Jul 09 22:03:18.599647 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:18.599594 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc8af26-55ff-492e-80f4-49e2d145e167" path="/var/lib/kubelet/pods/6bc8af26-55ff-492e-80f4-49e2d145e167/volumes" Jul 09 22:03:19.258610 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:19.258576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:19.263759 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:19.263731 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="6bc8af26-55ff-492e-80f4-49e2d145e167" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:20.596649 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:20.596614 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dz62s\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="6bc8af26-55ff-492e-80f4-49e2d145e167" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dz62s" Jul 09 22:03:20.612322 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:20.612294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:20.713391 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:20.713362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:21.014197 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:21.014173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:21.118136 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:21.118112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:24.603340 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:24.603312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:24.654512 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:24.654486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:29.155117 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.155084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:29.253896 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.253861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:29.260426 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.260399 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:29.260570 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.260559 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:29.317622 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.317595 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:29.317791 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.317753 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" podUID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" containerName="manager" containerID="cri-o://0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0" gracePeriod=10 Jul 09 22:03:29.539080 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.539050 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:03:29.541413 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.541394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.557033 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.557013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:03:29.569856 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.569836 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:29.654157 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.654121 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume\") pod \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " Jul 09 22:03:29.654276 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.654186 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z669\" (UniqueName: \"kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669\") pod \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\" (UID: \"4cfd5dce-89d5-434b-ae94-f5ac46059d88\") " Jul 09 22:03:29.654334 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.654272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns5vq\" (UniqueName: \"kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.654334 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.654296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.654440 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.654418 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4cfd5dce-89d5-434b-ae94-f5ac46059d88" (UID: "4cfd5dce-89d5-434b-ae94-f5ac46059d88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:03:29.655999 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.655969 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669" (OuterVolumeSpecName: "kube-api-access-5z669") pod "4cfd5dce-89d5-434b-ae94-f5ac46059d88" (UID: "4cfd5dce-89d5-434b-ae94-f5ac46059d88"). InnerVolumeSpecName "kube-api-access-5z669". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:03:29.755270 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.755246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns5vq\" (UniqueName: \"kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.755387 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.755278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.755387 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.755373 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cfd5dce-89d5-434b-ae94-f5ac46059d88-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:29.755496 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.755388 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z669\" (UniqueName: \"kubernetes.io/projected/4cfd5dce-89d5-434b-ae94-f5ac46059d88-kube-api-access-5z669\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:29.755691 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.755670 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.763245 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.763224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns5vq\" (UniqueName: \"kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq\") pod \"kuadrant-operator-controller-manager-86878c769f-hmmnm\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.867068 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.867045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:29.997877 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:29.997851 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:03:30.000536 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:03:30.000512 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfdd867_6d29_4334_a9b1_a2ce0599a799.slice/crio-099dcd4ed4fde68a5b6720f62c339069c5657d385ec006fe2befdd559a7308d0 WatchSource:0}: Error finding container 099dcd4ed4fde68a5b6720f62c339069c5657d385ec006fe2befdd559a7308d0: Status 404 returned error can't find the container with id 099dcd4ed4fde68a5b6720f62c339069c5657d385ec006fe2befdd559a7308d0 Jul 09 22:03:30.307562 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.307484 2564 generic.go:356] "Generic (PLEG): container finished" podID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" containerID="0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0" exitCode=0 Jul 09 22:03:30.307562 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.307528 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" Jul 09 22:03:30.308040 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.307567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" event={"ID":"4cfd5dce-89d5-434b-ae94-f5ac46059d88","Type":"ContainerDied","Data":"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0"} Jul 09 22:03:30.308040 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.307619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr" event={"ID":"4cfd5dce-89d5-434b-ae94-f5ac46059d88","Type":"ContainerDied","Data":"c90d413960f486d89efb8ba608f2698b565bd38f497d289dc06a3309376e054c"} Jul 09 22:03:30.308040 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.307643 2564 scope.go:117] "RemoveContainer" containerID="0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0" Jul 09 22:03:30.309466 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.309441 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" event={"ID":"1dfdd867-6d29-4334-a9b1-a2ce0599a799","Type":"ContainerStarted","Data":"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036"} Jul 09 22:03:30.309576 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.309488 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" event={"ID":"1dfdd867-6d29-4334-a9b1-a2ce0599a799","Type":"ContainerStarted","Data":"099dcd4ed4fde68a5b6720f62c339069c5657d385ec006fe2befdd559a7308d0"} Jul 09 22:03:30.309576 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.309544 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:30.316500 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.316481 2564 scope.go:117] "RemoveContainer" containerID="0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0" Jul 09 22:03:30.316780 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:30.316755 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0\": container with ID starting with 0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0 not found: ID does not exist" containerID="0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0" Jul 09 22:03:30.316865 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.316790 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0"} err="failed to get container status \"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0\": rpc error: code = NotFound desc = could not find container \"0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0\": container with ID starting with 0a089d6f508e75af7b20a5bbfd5288f4afef84c9a8c54fc5380e64dd2d482ac0 not found: ID does not exist" Jul 09 22:03:30.337391 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.337347 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" podStartSLOduration=1.337331299 podStartE2EDuration="1.337331299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:30.335843855 +0000 UTC m=+740.312982435" watchObservedRunningTime="2026-07-09 22:03:30.337331299 +0000 UTC m=+740.314469879" Jul 09 22:03:30.350531 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.350511 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:30.354771 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.354752 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bfdvr"] Jul 09 22:03:30.599506 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:30.599435 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" path="/var/lib/kubelet/pods/4cfd5dce-89d5-434b-ae94-f5ac46059d88/volumes" Jul 09 22:03:40.552118 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:40.552089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:40.619029 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:40.619001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:41.317772 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.317744 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:03:41.366933 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.366905 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:41.367167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.367127 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" podUID="233b43fd-b05d-4240-9112-b77020ed88be" containerName="manager" containerID="cri-o://14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c" gracePeriod=10 Jul 09 22:03:41.609505 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.609485 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:41.741097 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.741075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn95p\" (UniqueName: \"kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p\") pod \"233b43fd-b05d-4240-9112-b77020ed88be\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " Jul 09 22:03:41.741236 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.741126 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume\") pod \"233b43fd-b05d-4240-9112-b77020ed88be\" (UID: \"233b43fd-b05d-4240-9112-b77020ed88be\") " Jul 09 22:03:41.741517 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.741481 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "233b43fd-b05d-4240-9112-b77020ed88be" (UID: "233b43fd-b05d-4240-9112-b77020ed88be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:03:41.743121 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.743094 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p" (OuterVolumeSpecName: "kube-api-access-rn95p") pod "233b43fd-b05d-4240-9112-b77020ed88be" (UID: "233b43fd-b05d-4240-9112-b77020ed88be"). InnerVolumeSpecName "kube-api-access-rn95p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:03:41.841863 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.841840 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/233b43fd-b05d-4240-9112-b77020ed88be-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:41.841863 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:41.841861 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn95p\" (UniqueName: \"kubernetes.io/projected/233b43fd-b05d-4240-9112-b77020ed88be-kube-api-access-rn95p\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:03:42.366518 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.366489 2564 generic.go:356] "Generic (PLEG): container finished" podID="233b43fd-b05d-4240-9112-b77020ed88be" containerID="14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c" exitCode=0 Jul 09 22:03:42.366663 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.366531 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" Jul 09 22:03:42.366663 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.366576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" event={"ID":"233b43fd-b05d-4240-9112-b77020ed88be","Type":"ContainerDied","Data":"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c"} Jul 09 22:03:42.366663 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.366623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h" event={"ID":"233b43fd-b05d-4240-9112-b77020ed88be","Type":"ContainerDied","Data":"e4e1a225625483f77c3b9c1b367c15ff44f3ffd6bc0d01ed10191f3c3896f5a0"} Jul 09 22:03:42.366663 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.366644 2564 scope.go:117] "RemoveContainer" containerID="14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c" Jul 09 22:03:42.375509 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.375494 2564 scope.go:117] "RemoveContainer" containerID="14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c" Jul 09 22:03:42.375790 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:03:42.375771 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c\": container with ID starting with 14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c not found: ID does not exist" containerID="14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c" Jul 09 22:03:42.375870 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.375798 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c"} err="failed to get container status \"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c\": rpc error: code = NotFound desc = could not find container \"14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c\": container with ID starting with 14de5e6099d9002ead97e26371d5e08b02e55318ac5c3019d2230829a6ce1a4c not found: ID does not exist" Jul 09 22:03:42.390035 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.390014 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:42.396351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.396329 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6m88h"] Jul 09 22:03:42.599258 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:42.599234 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="233b43fd-b05d-4240-9112-b77020ed88be" path="/var/lib/kubelet/pods/233b43fd-b05d-4240-9112-b77020ed88be/volumes" Jul 09 22:03:45.687169 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:45.687080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:45.787524 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:45.787492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:03:59.953453 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:03:59.953414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:00.061937 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.061906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:00.129916 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.129889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:00.362516 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362447 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:04:00.362799 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362786 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" containerName="manager" Jul 09 22:04:00.362846 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362801 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" containerName="manager" Jul 09 22:04:00.362846 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362814 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="233b43fd-b05d-4240-9112-b77020ed88be" containerName="manager" Jul 09 22:04:00.362846 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362821 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="233b43fd-b05d-4240-9112-b77020ed88be" containerName="manager" Jul 09 22:04:00.362937 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362868 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cfd5dce-89d5-434b-ae94-f5ac46059d88" containerName="manager" Jul 09 22:04:00.362937 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.362875 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="233b43fd-b05d-4240-9112-b77020ed88be" containerName="manager" Jul 09 22:04:00.365916 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.365896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.368387 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.368368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 22:04:00.368475 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.368370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-86c5k\"" Jul 09 22:04:00.373610 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.373586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:04:00.407528 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.407502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:04:00.467100 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.467074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8818947c-ee5a-464b-8d94-bb35c2621593-config-file\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.467218 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.467122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqpz\" (UniqueName: \"kubernetes.io/projected/8818947c-ee5a-464b-8d94-bb35c2621593-kube-api-access-5cqpz\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.567556 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.567534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8818947c-ee5a-464b-8d94-bb35c2621593-config-file\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.567654 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.567583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqpz\" (UniqueName: \"kubernetes.io/projected/8818947c-ee5a-464b-8d94-bb35c2621593-kube-api-access-5cqpz\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.568185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.568144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8818947c-ee5a-464b-8d94-bb35c2621593-config-file\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.582200 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.582176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqpz\" (UniqueName: \"kubernetes.io/projected/8818947c-ee5a-464b-8d94-bb35c2621593-kube-api-access-5cqpz\") pod \"limitador-limitador-54d6d988d5-kkslm\" (UID: \"8818947c-ee5a-464b-8d94-bb35c2621593\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.677928 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.677880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:00.768199 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.768033 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:00.773019 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.772996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:00.775614 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.775593 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6chww\"" Jul 09 22:04:00.778082 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.777797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:00.797544 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.797518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:00.817117 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.817085 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:04:00.819408 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:04:00.819385 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8818947c_ee5a_464b_8d94_bb35c2621593.slice/crio-4e799b1055874155226a8c1495c44249578e90fea828c364405e1a3833160704 WatchSource:0}: Error finding container 4e799b1055874155226a8c1495c44249578e90fea828c364405e1a3833160704: Status 404 returned error can't find the container with id 4e799b1055874155226a8c1495c44249578e90fea828c364405e1a3833160704 Jul 09 22:04:00.857938 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.857911 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:00.871053 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.871031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzng\" (UniqueName: \"kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng\") pod \"authorino-58cd955675-xknmq\" (UID: \"40ff9c31-1d06-4b8f-b1ae-30ff80263c86\") " pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:00.971592 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.971565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzng\" (UniqueName: \"kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng\") pod \"authorino-58cd955675-xknmq\" (UID: \"40ff9c31-1d06-4b8f-b1ae-30ff80263c86\") " pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:00.980595 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:00.980575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzng\" (UniqueName: \"kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng\") pod \"authorino-58cd955675-xknmq\" (UID: \"40ff9c31-1d06-4b8f-b1ae-30ff80263c86\") " pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:01.085179 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:01.085142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:01.205820 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:01.205797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:01.208115 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:04:01.208088 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40ff9c31_1d06_4b8f_b1ae_30ff80263c86.slice/crio-09abd4ccbf0188140a11ff1dbe8b4b81254c425a90a4be910bbf81fd175de18a WatchSource:0}: Error finding container 09abd4ccbf0188140a11ff1dbe8b4b81254c425a90a4be910bbf81fd175de18a: Status 404 returned error can't find the container with id 09abd4ccbf0188140a11ff1dbe8b4b81254c425a90a4be910bbf81fd175de18a Jul 09 22:04:01.453089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:01.453054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xknmq" event={"ID":"40ff9c31-1d06-4b8f-b1ae-30ff80263c86","Type":"ContainerStarted","Data":"09abd4ccbf0188140a11ff1dbe8b4b81254c425a90a4be910bbf81fd175de18a"} Jul 09 22:04:01.454956 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:01.454925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" event={"ID":"8818947c-ee5a-464b-8d94-bb35c2621593","Type":"ContainerStarted","Data":"4e799b1055874155226a8c1495c44249578e90fea828c364405e1a3833160704"} Jul 09 22:04:05.479995 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:05.479964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" event={"ID":"8818947c-ee5a-464b-8d94-bb35c2621593","Type":"ContainerStarted","Data":"40cd07c8f9ed3cea2bd46576423f92b42025582e62f52252471a641e1c0c309a"} Jul 09 22:04:05.480452 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:05.480066 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:05.481439 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:05.481414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xknmq" event={"ID":"40ff9c31-1d06-4b8f-b1ae-30ff80263c86","Type":"ContainerStarted","Data":"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169"} Jul 09 22:04:05.500120 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:05.500078 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" podStartSLOduration=1.138920136 podStartE2EDuration="5.500063341s" totalImagesPullingTime="4.361143205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:05.498933163 +0000 UTC m=+775.476071744" watchObservedRunningTime="2026-07-09 22:04:05.500063341 +0000 UTC m=+775.477201921" Jul 09 22:04:05.518340 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:05.518306 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xknmq" podStartSLOduration=1.538960222 podStartE2EDuration="5.518294765s" totalImagesPullingTime="3.979334543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:05.51635042 +0000 UTC m=+775.493489011" watchObservedRunningTime="2026-07-09 22:04:05.518294765 +0000 UTC m=+775.495433345" Jul 09 22:04:06.204447 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:06.204417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:07.491219 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:07.491174 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xknmq" podUID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" containerName="authorino" containerID="cri-o://0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169" gracePeriod=30 Jul 09 22:04:07.737331 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:07.737312 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:07.822307 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:07.822252 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rzng\" (UniqueName: \"kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng\") pod \"40ff9c31-1d06-4b8f-b1ae-30ff80263c86\" (UID: \"40ff9c31-1d06-4b8f-b1ae-30ff80263c86\") " Jul 09 22:04:07.824158 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:07.824118 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng" (OuterVolumeSpecName: "kube-api-access-7rzng") pod "40ff9c31-1d06-4b8f-b1ae-30ff80263c86" (UID: "40ff9c31-1d06-4b8f-b1ae-30ff80263c86"). InnerVolumeSpecName "kube-api-access-7rzng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:04:07.923641 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:07.923620 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rzng\" (UniqueName: \"kubernetes.io/projected/40ff9c31-1d06-4b8f-b1ae-30ff80263c86-kube-api-access-7rzng\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:04:08.496772 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.496743 2564 generic.go:356] "Generic (PLEG): container finished" podID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" containerID="0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169" exitCode=0 Jul 09 22:04:08.497185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.496785 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xknmq" Jul 09 22:04:08.497185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.496790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xknmq" event={"ID":"40ff9c31-1d06-4b8f-b1ae-30ff80263c86","Type":"ContainerDied","Data":"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169"} Jul 09 22:04:08.497185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.496820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xknmq" event={"ID":"40ff9c31-1d06-4b8f-b1ae-30ff80263c86","Type":"ContainerDied","Data":"09abd4ccbf0188140a11ff1dbe8b4b81254c425a90a4be910bbf81fd175de18a"} Jul 09 22:04:08.497185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.496838 2564 scope.go:117] "RemoveContainer" containerID="0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169" Jul 09 22:04:08.505800 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.505780 2564 scope.go:117] "RemoveContainer" containerID="0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169" Jul 09 22:04:08.506091 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:04:08.506070 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169\": container with ID starting with 0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169 not found: ID does not exist" containerID="0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169" Jul 09 22:04:08.506210 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.506103 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169"} err="failed to get container status \"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169\": rpc error: code = NotFound desc = could not find container \"0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169\": container with ID starting with 0b00d9d8f3cb7a0b0cca5468b2aebf679ae138ca2dd0f5955ad485759ee34169 not found: ID does not exist" Jul 09 22:04:08.518324 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.518302 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:08.522167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.522136 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xknmq"] Jul 09 22:04:08.598718 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:08.598697 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" path="/var/lib/kubelet/pods/40ff9c31-1d06-4b8f-b1ae-30ff80263c86/volumes" Jul 09 22:04:16.487282 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:16.487253 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kkslm" Jul 09 22:04:21.801805 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:21.801774 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:21.898246 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:21.898217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:22.310595 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:22.310569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:35.634012 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:35.633933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:35.941744 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:35.941653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:36.064800 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.064775 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-pl67v"] Jul 09 22:04:36.065089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.065077 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" containerName="authorino" Jul 09 22:04:36.065136 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.065090 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" containerName="authorino" Jul 09 22:04:36.065186 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.065165 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ff9c31-1d06-4b8f-b1ae-30ff80263c86" containerName="authorino" Jul 09 22:04:36.072481 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.072462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.074786 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.074764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-pl67v"] Jul 09 22:04:36.075537 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.075521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6chww\"" Jul 09 22:04:36.075589 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.075521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 22:04:36.115875 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.115855 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-pl67v"] Jul 09 22:04:36.116042 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:04:36.116019 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2z897 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-pl67v" podUID="0a7f85ca-abc5-4d41-be3b-5cbd70de8b90" Jul 09 22:04:36.127641 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.127614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.127743 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.127663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z897\" (UniqueName: \"kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.228553 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.228531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z897\" (UniqueName: \"kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.228687 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.228622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.230935 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.230915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.236239 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.236213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z897\" (UniqueName: \"kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897\") pod \"authorino-76877994-pl67v\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.615796 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.615732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.622363 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.622340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:36.731645 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.731620 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert\") pod \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " Jul 09 22:04:36.731987 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.731684 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z897\" (UniqueName: \"kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897\") pod \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\" (UID: \"0a7f85ca-abc5-4d41-be3b-5cbd70de8b90\") " Jul 09 22:04:36.733599 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.733570 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0a7f85ca-abc5-4d41-be3b-5cbd70de8b90" (UID: "0a7f85ca-abc5-4d41-be3b-5cbd70de8b90"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:04:36.733678 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.733620 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897" (OuterVolumeSpecName: "kube-api-access-2z897") pod "0a7f85ca-abc5-4d41-be3b-5cbd70de8b90" (UID: "0a7f85ca-abc5-4d41-be3b-5cbd70de8b90"). InnerVolumeSpecName "kube-api-access-2z897". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:04:36.832872 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.832853 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-tls-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:04:36.832872 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:36.832873 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z897\" (UniqueName: \"kubernetes.io/projected/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90-kube-api-access-2z897\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:04:37.620131 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:37.620100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-pl67v" Jul 09 22:04:37.650374 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:37.650348 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-pl67v"] Jul 09 22:04:37.652941 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:37.652916 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-pl67v"] Jul 09 22:04:38.597914 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:38.597879 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7f85ca-abc5-4d41-be3b-5cbd70de8b90" path="/var/lib/kubelet/pods/0a7f85ca-abc5-4d41-be3b-5cbd70de8b90/volumes" Jul 09 22:04:41.779488 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:41.779459 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:42.218964 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:42.218938 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:42.273208 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:42.273183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:46.601042 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:46.601007 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:04:46.702394 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:04:46.702360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:16.864810 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:16.864775 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:17.375442 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:17.375408 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:17.511024 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:17.510991 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:17.921514 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:17.921484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:18.025223 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:18.025194 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:18.136046 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:18.136019 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:05:29.052873 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:29.052801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:29.153053 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:29.153015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:42.092800 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:42.092767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:05:42.530938 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:05:42.530910 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:06:09.626452 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:09.626419 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:10.337167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:10.337113 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:06:10.432815 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:10.432793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:06:10.434285 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:10.434266 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:06:15.124941 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:15.124904 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:16.289023 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:16.288985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:27.088371 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.088341 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd"] Jul 09 22:06:27.091819 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.091800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.094346 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.094326 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x55j4\"" Jul 09 22:06:27.094455 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.094344 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 22:06:27.094541 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.094381 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 22:06:27.095527 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.095509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 22:06:27.103692 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.103665 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd"] Jul 09 22:06:27.135020 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.134997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:27.146114 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.146237 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.146237 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.146237 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146231 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.146405 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.146405 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.146282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w54g\" (UniqueName: \"kubernetes.io/projected/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-kube-api-access-8w54g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247304 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247393 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247393 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247480 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247480 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247480 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w54g\" (UniqueName: \"kubernetes.io/projected/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-kube-api-access-8w54g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247748 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247817 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.247872 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.247825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.249523 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.249507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.249805 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.249785 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.257380 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.257357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w54g\" (UniqueName: \"kubernetes.io/projected/efd3cbdf-5b96-44f7-a66f-5f8682b1ae85-kube-api-access-8w54g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bg4fd\" (UID: \"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.404969 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.404910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:27.531244 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:27.531220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd"] Jul 09 22:06:27.533759 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:06:27.533731 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd3cbdf_5b96_44f7_a66f_5f8682b1ae85.slice/crio-8ee8f9f9b055f79c0165c823ae11a332a4077a5033e47abe102f0c3f429e754c WatchSource:0}: Error finding container 8ee8f9f9b055f79c0165c823ae11a332a4077a5033e47abe102f0c3f429e754c: Status 404 returned error can't find the container with id 8ee8f9f9b055f79c0165c823ae11a332a4077a5033e47abe102f0c3f429e754c Jul 09 22:06:28.078408 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:28.078370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" event={"ID":"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85","Type":"ContainerStarted","Data":"8ee8f9f9b055f79c0165c823ae11a332a4077a5033e47abe102f0c3f429e754c"} Jul 09 22:06:28.245213 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:28.245183 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:06:29.086167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:29.086108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" event={"ID":"efd3cbdf-5b96-44f7-a66f-5f8682b1ae85","Type":"ContainerStarted","Data":"8dbabb1e01ab9f515b09c500fe6b6c03de14c740801f02639b5c2ce8c7e19d89"} Jul 09 22:06:29.104358 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:29.104314 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" podStartSLOduration=1.076872841 podStartE2EDuration="2.104294238s" totalImagesPullingTime="1.027421397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:06:29.102216145 +0000 UTC m=+919.079354725" watchObservedRunningTime="2026-07-09 22:06:29.104294238 +0000 UTC m=+919.081432817" Jul 09 22:06:33.220484 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:33.220451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:34.847819 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:34.847779 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:06:37.405030 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:37.405001 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:37.405410 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:37.405051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:37.417199 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:37.417179 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:38.141300 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:38.141272 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bg4fd" Jul 09 22:06:50.753027 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:50.752994 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:54.021596 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.021566 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2"] Jul 09 22:06:54.028045 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.028026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.031108 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.031084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 22:06:54.037501 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.037478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2"] Jul 09 22:06:54.062134 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.062106 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:06:54.140555 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.140658 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.140658 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c96447-68bd-4270-a8f3-12c4ff163469-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.140736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.140736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.140736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.140710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/15c96447-68bd-4270-a8f3-12c4ff163469-kube-api-access-lbplb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241488 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241617 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241617 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c96447-68bd-4270-a8f3-12c4ff163469-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241617 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241617 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241832 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/15c96447-68bd-4270-a8f3-12c4ff163469-kube-api-access-lbplb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241893 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.241949 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.241918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.242053 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.242035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.243700 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.243681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c96447-68bd-4270-a8f3-12c4ff163469-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.243822 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.243805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c96447-68bd-4270-a8f3-12c4ff163469-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.251621 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.251600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbplb\" (UniqueName: \"kubernetes.io/projected/15c96447-68bd-4270-a8f3-12c4ff163469-kube-api-access-lbplb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9nv2\" (UID: \"15c96447-68bd-4270-a8f3-12c4ff163469\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.338749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.338701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:06:54.475455 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:54.475427 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2"] Jul 09 22:06:54.478699 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:06:54.478660 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c96447_68bd_4270_a8f3_12c4ff163469.slice/crio-1c27144d1d31f7b630c4753dcc52a41d33748a3fb6447db7daaad82c2345799b WatchSource:0}: Error finding container 1c27144d1d31f7b630c4753dcc52a41d33748a3fb6447db7daaad82c2345799b: Status 404 returned error can't find the container with id 1c27144d1d31f7b630c4753dcc52a41d33748a3fb6447db7daaad82c2345799b Jul 09 22:06:55.204027 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:55.203997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" event={"ID":"15c96447-68bd-4270-a8f3-12c4ff163469","Type":"ContainerStarted","Data":"439ee600056d946c9d09b0b5b2b6695aa12fe324cab7b1cc4d6ae7bab329ac54"} Jul 09 22:06:55.204402 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:55.204046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" event={"ID":"15c96447-68bd-4270-a8f3-12c4ff163469","Type":"ContainerStarted","Data":"1c27144d1d31f7b630c4753dcc52a41d33748a3fb6447db7daaad82c2345799b"} Jul 09 22:06:55.224239 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:55.224196 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" podStartSLOduration=2.028201318 podStartE2EDuration="2.224183525s" totalImagesPullingTime="195.982207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:06:55.223544977 +0000 UTC m=+945.200683558" watchObservedRunningTime="2026-07-09 22:06:55.224183525 +0000 UTC m=+945.201322106" Jul 09 22:06:55.848771 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:06:55.848731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:07:00.186748 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.186714 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5"] Jul 09 22:07:00.190128 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.190108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.193702 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.193676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 22:07:00.201360 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.201338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5"] Jul 09 22:07:00.255396 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.255366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:07:00.293609 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.293708 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznxc\" (UniqueName: \"kubernetes.io/projected/c5291d3e-7716-4606-91a8-eef90ea4a303-kube-api-access-zznxc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.293708 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.293808 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.293808 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5291d3e-7716-4606-91a8-eef90ea4a303-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.293808 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.293776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.394961 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.394935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395050 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.394968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zznxc\" (UniqueName: \"kubernetes.io/projected/c5291d3e-7716-4606-91a8-eef90ea4a303-kube-api-access-zznxc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395050 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.394989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395050 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395201 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5291d3e-7716-4606-91a8-eef90ea4a303-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395201 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395432 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395525 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.395571 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.395534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.397296 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.397277 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5291d3e-7716-4606-91a8-eef90ea4a303-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.397564 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.397545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5291d3e-7716-4606-91a8-eef90ea4a303-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.404490 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.404473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznxc\" (UniqueName: \"kubernetes.io/projected/c5291d3e-7716-4606-91a8-eef90ea4a303-kube-api-access-zznxc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5\" (UID: \"c5291d3e-7716-4606-91a8-eef90ea4a303\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.503448 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.503428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:00.644422 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:00.644401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5"] Jul 09 22:07:00.645950 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:07:00.645925 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5291d3e_7716_4606_91a8_eef90ea4a303.slice/crio-041f0be41af9fef22fbdfb20a252891743acfc4d677158cbc285256c7cc69338 WatchSource:0}: Error finding container 041f0be41af9fef22fbdfb20a252891743acfc4d677158cbc285256c7cc69338: Status 404 returned error can't find the container with id 041f0be41af9fef22fbdfb20a252891743acfc4d677158cbc285256c7cc69338 Jul 09 22:07:01.233319 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:01.233289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" event={"ID":"c5291d3e-7716-4606-91a8-eef90ea4a303","Type":"ContainerStarted","Data":"f532e1092bb75320026797636fca291b6c50f9cc6f6f18c5adc7da76770f8cc9"} Jul 09 22:07:01.233688 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:01.233329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" event={"ID":"c5291d3e-7716-4606-91a8-eef90ea4a303","Type":"ContainerStarted","Data":"041f0be41af9fef22fbdfb20a252891743acfc4d677158cbc285256c7cc69338"} Jul 09 22:07:02.544625 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:02.544572 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" podStartSLOduration=2.310041359 podStartE2EDuration="2.544557391s" totalImagesPullingTime="234.516032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:07:01.254047502 +0000 UTC m=+951.231186082" watchObservedRunningTime="2026-07-09 22:07:02.544557391 +0000 UTC m=+952.521695970" Jul 09 22:07:02.545165 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:02.545129 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:07:04.339520 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:04.339489 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:07:04.339890 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:04.339791 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:07:04.351830 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:04.351812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:07:05.261020 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:05.260993 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9nv2" Jul 09 22:07:10.504347 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:10.504316 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:10.504710 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:10.504360 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:10.516811 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:10.516788 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:11.285494 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:11.285457 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5" Jul 09 22:07:18.773950 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:18.773910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:07:18.843042 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:18.843013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:07:28.211363 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:28.211327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:07:47.259101 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:07:47.259019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:08:17.555899 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:17.555865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:08:17.651753 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:17.651727 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:08:18.762925 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:18.762893 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:08:18.860855 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:18.860824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:08:45.254770 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:45.254725 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:08:56.340527 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:08:56.340495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:09:07.735108 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:07.735036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:09:11.205577 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:11.205545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:09:16.238570 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:16.238539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:09:22.404503 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:22.404468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:09:26.783442 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:26.783397 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:09:29.693574 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:29.693542 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:09:31.116830 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:31.116798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:09:54.359089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:09:54.359055 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:10:05.139234 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:05.139204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:10:12.051871 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:12.051810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:12.146762 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:12.146737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:12.272278 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:12.272234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:17.860463 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:17.860426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:17.926949 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:17.926923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:18.007737 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:18.007688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:18.109680 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:18.109655 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:18.221485 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:18.221463 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:24.088612 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:24.088564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:24.188018 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:24.187990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:10:40.433843 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:40.433772 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:10:49.541255 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:49.541222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:10:56.741647 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:10:56.741611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:05.835285 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:05.835252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:10.457076 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:10.457047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:11:10.460970 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:10.460948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:11:16.248269 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:16.248235 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:25.362005 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:25.347267 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:36.738026 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:36.737992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:41.150474 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:41.150447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:11:46.747138 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:46.747107 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:11:56.042213 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:11:56.042181 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:12:09.047316 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:12:09.047245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:12:18.038710 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:12:18.038665 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:12:41.543077 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:12:41.543039 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:12:53.239659 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:12:53.239626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:13:05.514906 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:05.514865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:13:05.610227 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:05.610201 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:13:07.638815 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:07.638784 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:13:17.442877 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:17.442841 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:13:28.537947 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:28.537915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:13:37.449535 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:37.449463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:13:46.150955 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:13:46.150924 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:14:13.094064 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:13.094032 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:14:13.094574 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:13.094227 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" podUID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" containerName="manager" containerID="cri-o://aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036" gracePeriod=10 Jul 09 22:14:15.749308 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:15.749284 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:14:15.910420 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:15.910351 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume\") pod \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " Jul 09 22:14:15.910549 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:15.910445 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns5vq\" (UniqueName: \"kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq\") pod \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\" (UID: \"1dfdd867-6d29-4334-a9b1-a2ce0599a799\") " Jul 09 22:14:15.910720 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:15.910687 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1dfdd867-6d29-4334-a9b1-a2ce0599a799" (UID: "1dfdd867-6d29-4334-a9b1-a2ce0599a799"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:14:15.912304 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:15.912280 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq" (OuterVolumeSpecName: "kube-api-access-ns5vq") pod "1dfdd867-6d29-4334-a9b1-a2ce0599a799" (UID: "1dfdd867-6d29-4334-a9b1-a2ce0599a799"). InnerVolumeSpecName "kube-api-access-ns5vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:14:16.011538 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.011515 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns5vq\" (UniqueName: \"kubernetes.io/projected/1dfdd867-6d29-4334-a9b1-a2ce0599a799-kube-api-access-ns5vq\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:14:16.011538 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.011534 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfdd867-6d29-4334-a9b1-a2ce0599a799-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:14:16.141773 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.141743 2564 generic.go:356] "Generic (PLEG): container finished" podID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" containerID="aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036" exitCode=0 Jul 09 22:14:16.141892 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.141819 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" Jul 09 22:14:16.141892 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.141828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" event={"ID":"1dfdd867-6d29-4334-a9b1-a2ce0599a799","Type":"ContainerDied","Data":"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036"} Jul 09 22:14:16.142017 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.141908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm" event={"ID":"1dfdd867-6d29-4334-a9b1-a2ce0599a799","Type":"ContainerDied","Data":"099dcd4ed4fde68a5b6720f62c339069c5657d385ec006fe2befdd559a7308d0"} Jul 09 22:14:16.142017 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.141934 2564 scope.go:117] "RemoveContainer" containerID="aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036" Jul 09 22:14:16.151783 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.151766 2564 scope.go:117] "RemoveContainer" containerID="aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036" Jul 09 22:14:16.152033 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:14:16.152016 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036\": container with ID starting with aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036 not found: ID does not exist" containerID="aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036" Jul 09 22:14:16.152081 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.152040 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036"} err="failed to get container status \"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036\": rpc error: code = NotFound desc = could not find container \"aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036\": container with ID starting with aa3e524cebfe69dbb60d4ac0496acab3492ec0a2062169acf5ab4a9ba3bf8036 not found: ID does not exist" Jul 09 22:14:16.163637 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.163580 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:14:16.167213 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.167193 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hmmnm"] Jul 09 22:14:16.598685 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:16.598657 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" path="/var/lib/kubelet/pods/1dfdd867-6d29-4334-a9b1-a2ce0599a799/volumes" Jul 09 22:14:25.902467 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:14:25.902434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:15:14.401541 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.401508 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4"] Jul 09 22:15:14.401924 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.401863 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" containerName="manager" Jul 09 22:15:14.401924 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.401877 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" containerName="manager" Jul 09 22:15:14.402000 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.401944 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dfdd867-6d29-4334-a9b1-a2ce0599a799" containerName="manager" Jul 09 22:15:14.404865 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.404850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.407918 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.407896 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7cfx8\"" Jul 09 22:15:14.422055 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.422028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4"] Jul 09 22:15:14.527692 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.527668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp9wz\" (UniqueName: \"kubernetes.io/projected/e0965f0e-0587-45bd-8494-8d6893ad1767-kube-api-access-wp9wz\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.527816 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.527701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0965f0e-0587-45bd-8494-8d6893ad1767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.628440 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.628421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp9wz\" (UniqueName: \"kubernetes.io/projected/e0965f0e-0587-45bd-8494-8d6893ad1767-kube-api-access-wp9wz\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.628536 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.628453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0965f0e-0587-45bd-8494-8d6893ad1767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.628747 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.628732 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0965f0e-0587-45bd-8494-8d6893ad1767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.641294 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.641267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp9wz\" (UniqueName: \"kubernetes.io/projected/e0965f0e-0587-45bd-8494-8d6893ad1767-kube-api-access-wp9wz\") pod \"kuadrant-operator-controller-manager-86878c769f-862m4\" (UID: \"e0965f0e-0587-45bd-8494-8d6893ad1767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.715250 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.715229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:14.855206 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:14.855175 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4"] Jul 09 22:15:14.857103 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:15:14.857064 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0965f0e_0587_45bd_8494_8d6893ad1767.slice/crio-c0be3d010a766fd13e1f32c03c5b4dba0ae39dbdda4609eaaefd1d375ae33d95 WatchSource:0}: Error finding container c0be3d010a766fd13e1f32c03c5b4dba0ae39dbdda4609eaaefd1d375ae33d95: Status 404 returned error can't find the container with id c0be3d010a766fd13e1f32c03c5b4dba0ae39dbdda4609eaaefd1d375ae33d95 Jul 09 22:15:15.402582 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:15.402544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" event={"ID":"e0965f0e-0587-45bd-8494-8d6893ad1767","Type":"ContainerStarted","Data":"5d3b6b24b0d979ca1c5e44f51d20db5a91e128d89d4a59107a49aaf25961aeb5"} Jul 09 22:15:15.402984 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:15.402600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" event={"ID":"e0965f0e-0587-45bd-8494-8d6893ad1767","Type":"ContainerStarted","Data":"c0be3d010a766fd13e1f32c03c5b4dba0ae39dbdda4609eaaefd1d375ae33d95"} Jul 09 22:15:15.402984 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:15.402623 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:15.428110 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:15.428067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" podStartSLOduration=1.42805272 podStartE2EDuration="1.42805272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:15.425184696 +0000 UTC m=+1445.402323286" watchObservedRunningTime="2026-07-09 22:15:15.42805272 +0000 UTC m=+1445.405191300" Jul 09 22:15:26.408987 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:26.408957 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-862m4" Jul 09 22:15:35.148270 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:35.148237 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:15:45.450201 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:45.450165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:15:55.447492 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:15:55.447459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:06.247424 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:06.247388 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:10.490462 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:10.490433 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:16:10.498733 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:10.498710 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:16:17.339445 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:17.339410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:29.167881 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:29.167843 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:37.948272 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:37.948189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:48.361244 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:48.361212 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:16:59.557477 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:16:59.557446 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:17:07.141268 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:17:07.141236 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:17:15.649615 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:17:15.649584 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:17:22.366191 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:17:22.366142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:17:43.356541 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:17:43.356509 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:17:52.254919 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:17:52.254885 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:03.644034 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:03.643952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:12.944101 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:12.944063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:23.292925 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:23.292893 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:18:28.950526 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:28.950494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:38.144689 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:38.144658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:47.340648 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:47.340616 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:18:57.345324 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:18:57.345294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:19:06.443191 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:19:06.443142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:19:15.946117 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:19:15.946083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:19:28.550197 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:19:28.550158 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:19:37.344103 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:19:37.344028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:19:49.157294 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:19:49.157260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:00.642714 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:00.642680 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:10.053305 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:10.053274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:16.349649 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:16.349617 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:33.344535 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:33.344501 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:44.940271 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:44.940235 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:54.143781 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:54.143747 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:20:56.400848 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:20:56.400810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:01.729892 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:01.729851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:06.351063 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:06.350986 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:21:10.005173 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:10.005110 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:10.518703 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:10.518678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:21:10.527324 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:10.527303 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:21:14.935534 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:14.935497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:21:15.213804 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:15.213767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:18.262873 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:18.262841 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:18.354545 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:18.354520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:18.748891 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:18.748853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:22.541287 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:22.541250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:24.481603 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:24.481563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:24.542847 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:24.542818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:21:24.585622 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:24.585592 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:24.708883 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:24.708851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:24.807384 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:24.807305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:25.895655 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:25.895615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:25.998881 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:25.998836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:26.081537 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:26.081498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:26.230883 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:26.230851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:26.657291 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:26.657208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:26.759223 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:26.759197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:28.807541 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:28.807502 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:31.012082 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:31.012042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:31.210070 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:31.210034 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:31.329618 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:31.329552 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:31.413762 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:31.413731 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:33.024356 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:33.024331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:37.083541 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:37.083508 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:37.236736 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:37.236707 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:37.392660 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:37.392624 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:37.487968 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:37.487936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:38.517060 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:38.517013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:38.606504 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:38.606470 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:38.671973 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:38.671926 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:39.300174 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:39.300119 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:39.420717 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:39.420685 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:40.857201 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:40.857168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:41.168097 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:41.168023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:21:43.633846 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:43.633806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:44.030399 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:44.030371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:49.815136 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:49.815102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:49.923257 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:49.923229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:51.934737 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:51.934702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:21:52.088682 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:52.088622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:55.737222 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:55.737187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:55.836513 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:55.836476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:55.973821 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:55.973783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:56.074121 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:56.074050 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.072529 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.072488 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.171549 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.171516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.346140 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.346068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.571125 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.571091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.767999 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.767968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:57.869181 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:57.869157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:21:59.317940 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:21:59.317885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:01.506603 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:01.506551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:01.689667 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:01.689631 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:01.796733 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:01.796659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:01.950046 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:01.950017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:03.298081 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:03.298051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:07.639000 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:07.638966 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:07.741625 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:07.741578 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:08.109019 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:08.108988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:08.203852 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:08.203816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:08.269704 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:08.269681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:09.710503 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:09.710462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:15.621987 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:15.621948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:15.733450 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:15.733411 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:15.872488 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:15.872418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:15.969175 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:15.969132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:16.394877 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:16.394845 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:42.373188 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:42.373094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:48.048686 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:48.048650 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:48.155662 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:48.155632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:22:48.248122 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:22:48.248094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:04.147849 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:04.147808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:10.074579 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:10.074545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:10.134419 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:10.134386 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:10.225642 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:10.225618 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:10.344983 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:10.344917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:20.840636 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:20.840598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:21.663389 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:21.663349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:27.498027 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:27.497992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:28.732866 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:28.732829 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:30.432872 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:30.432831 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:30.868370 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:30.868338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:23:36.078497 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:36.078458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:36.139921 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:36.139893 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:36.793661 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:36.793631 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:39.950195 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:39.950159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:23:42.769871 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:42.769832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:42.836042 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:42.836007 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:43.081460 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:43.081382 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:43.371377 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:43.371295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:43.523670 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:43.523635 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:46.723869 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:46.723829 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:46.821908 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:46.821868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:46.927865 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:46.927835 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:47.093898 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:47.093815 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:47.801951 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:47.801914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:47.899697 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:47.899666 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:51.237165 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:51.237115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:51.919830 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:51.919789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:52.019822 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:52.019796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:52.327297 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:52.327263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:53.569376 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:53.569339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:23:58.194360 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:58.194323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:58.255743 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:58.255710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:58.628909 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:58.628876 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:58.998885 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:58.998852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:23:59.125472 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:23:59.125429 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:01.879197 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:01.879139 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:24:04.813720 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:04.813634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:04.873931 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:04.873903 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:05.102314 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:05.102228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:05.470902 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:05.470864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:05.559051 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:05.559020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:05.681418 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:05.681390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:11.340067 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:11.340029 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:11.442630 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:11.442593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:11.539675 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:11.539644 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:11.713058 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:11.713026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:17.533836 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:17.533793 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:17.631551 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:17.631518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:24.372466 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:24.372430 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:24.677659 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:24.677579 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:25.325433 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:25.325381 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.039284 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.039249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.130214 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.130184 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.279210 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.279180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.651014 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.650986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.799566 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.799536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:28.900768 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:28.900732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:32.432914 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:32.432874 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:32.938543 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:32.938505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:24:43.234255 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:43.234218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:46.652918 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:46.652887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:24:53.464507 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:53.464453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:24:53.563124 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:24:53.563081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:12.550877 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:12.550835 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:25:15.147435 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:15.147393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:15.647721 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:15.647684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:15.748300 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:15.748264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:15.936670 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:15.936571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:17.903871 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:17.903833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:21.279576 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:21.279539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:26.296772 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:26.296742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:26.642191 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:26.642097 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:25:47.684656 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:47.684577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:47.875097 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:47.875068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:50.844133 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:50.844100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:25:53.729803 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:53.729761 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:53.829825 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:53.829795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:54.034452 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:54.034375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:55.383226 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:55.383190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:55.491793 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:55.491762 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:55.592134 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:55.592100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:56.365531 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:56.365504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:56.464246 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:56.464213 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:56.566617 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:56.566585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:25:58.034388 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:25:58.034354 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:02.050306 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:02.050268 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:26:04.167395 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:04.167362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:04.267706 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:04.267672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:04.768818 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:04.768787 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:10.503605 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:10.503577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:10.545746 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:10.545722 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:26:10.555832 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:10.555808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:26:10.607378 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:10.607344 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:10.823072 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:10.822976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:11.145972 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:11.145906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:26:21.261789 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:21.261729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:21.630896 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:21.630811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:42.610477 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:42.610439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:48.642164 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:48.642109 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:48.708071 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:48.708024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:49.013022 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:49.012990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:49.342285 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:49.342192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:49.450029 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:49.449992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:52.576266 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:52.576236 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:52.655473 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:52.655433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:52.720534 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:52.720482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:53.106993 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:53.106967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:53.304366 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:53.304331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:53.403811 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:53.403737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:57.116107 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:57.116076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:57.487370 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:57.487342 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:57.825749 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:57.825654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:58.402563 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:58.402525 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:58.659016 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:58.658910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:26:58.741287 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:26:58.741261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:27:00.663680 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:00.663643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:00.754890 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:00.754850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:00.851519 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:00.851489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:01.208628 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:01.208590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:01.456123 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:01.456095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:01.532707 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:01.532605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:05.199390 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:05.199306 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:10.442869 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:10.442835 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:27:14.135426 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:14.135389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:14.236504 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:14.236473 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:23.324414 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:23.324378 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:23.425735 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:23.425704 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:42.499228 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.499181 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:27:42.502865 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.502845 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.506745 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.506721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-55e48b\"/\"openshift-service-ca.crt\"" Jul 09 22:27:42.507440 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.507414 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-55e48b\"/\"default-dockercfg-m9568\"" Jul 09 22:27:42.507778 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.507752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-55e48b\"/\"kube-root-ca.crt\"" Jul 09 22:27:42.507937 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.507788 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-55e48b\"/\"test-model-55e48b-kserve-self-signed-certs\"" Jul 09 22:27:42.513687 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.513661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:27:42.534131 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.534098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:42.599851 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.599946 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvrw\" (UniqueName: \"kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.599946 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.599946 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.599946 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.600107 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.599994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700457 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700579 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700579 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvrw\" (UniqueName: \"kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700680 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700737 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700792 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700862 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.700950 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.700932 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.701075 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.701057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.702721 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.702698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.703095 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.703078 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.708829 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.708810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvrw\" (UniqueName: \"kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw\") pod \"test-model-55e48b-kserve-5d84549c87-r8gg2\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.819536 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.819482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:42.952518 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:42.952495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:27:42.954656 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:27:42.954628 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8a413e5_9618_4497_8c6c_fddc2eb3342d.slice/crio-3e988eb2d939b5b06bd50524c23387e519dd8556d8f6e87f765adb2bcf422563 WatchSource:0}: Error finding container 3e988eb2d939b5b06bd50524c23387e519dd8556d8f6e87f765adb2bcf422563: Status 404 returned error can't find the container with id 3e988eb2d939b5b06bd50524c23387e519dd8556d8f6e87f765adb2bcf422563 Jul 09 22:27:43.685656 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:43.685616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" event={"ID":"a8a413e5-9618-4497-8c6c-fddc2eb3342d","Type":"ContainerStarted","Data":"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6"} Jul 09 22:27:43.685656 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:43.685654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" event={"ID":"a8a413e5-9618-4497-8c6c-fddc2eb3342d","Type":"ContainerStarted","Data":"3e988eb2d939b5b06bd50524c23387e519dd8556d8f6e87f765adb2bcf422563"} Jul 09 22:27:43.706569 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:43.706513 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" podStartSLOduration=1.706498543 podStartE2EDuration="1.706498543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:27:43.705383799 +0000 UTC m=+2193.682522379" watchObservedRunningTime="2026-07-09 22:27:43.706498543 +0000 UTC m=+2193.683637123" Jul 09 22:27:45.943765 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:45.943736 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:27:52.819809 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:52.819741 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:52.819809 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:52.819807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:52.832620 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:52.832599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:53.738402 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:53.738374 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:27:56.638169 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:56.638113 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:27:56.641878 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:56.641848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:27:56.740755 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:27:56.740728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:06.129169 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:06.129106 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:11.941434 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:11.941405 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:28:24.583286 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:24.583251 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:28:24.602968 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:24.602927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:25.514348 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:25.514308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:25.719018 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:25.718982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:26.096386 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:26.096361 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:26.193260 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:26.193217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:26.294246 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:26.294214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:26.414347 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:26.414267 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:29.684738 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:29.684702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:28:31.173641 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:31.173607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:39.604045 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.603945 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" podUID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" containerName="main" containerID="cri-o://43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6" gracePeriod=45 Jul 09 22:28:39.847684 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.847664 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:28:39.932118 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.932047 2564 generic.go:356] "Generic (PLEG): container finished" podID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" containerID="43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6" exitCode=0 Jul 09 22:28:39.932118 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.932083 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" Jul 09 22:28:39.932118 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.932102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" event={"ID":"a8a413e5-9618-4497-8c6c-fddc2eb3342d","Type":"ContainerDied","Data":"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6"} Jul 09 22:28:39.932302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.932132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2" event={"ID":"a8a413e5-9618-4497-8c6c-fddc2eb3342d","Type":"ContainerDied","Data":"3e988eb2d939b5b06bd50524c23387e519dd8556d8f6e87f765adb2bcf422563"} Jul 09 22:28:39.932302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.932168 2564 scope.go:117] "RemoveContainer" containerID="43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6" Jul 09 22:28:39.940191 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.940175 2564 scope.go:117] "RemoveContainer" containerID="43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6" Jul 09 22:28:39.940445 ip-10-0-133-173 kubenswrapper[2564]: E0709 22:28:39.940427 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6\": container with ID starting with 43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6 not found: ID does not exist" containerID="43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6" Jul 09 22:28:39.940492 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.940454 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6"} err="failed to get container status \"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6\": rpc error: code = NotFound desc = could not find container \"43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6\": container with ID starting with 43c6f0176413ca341c6874ddb1de8477d6401465db5e71ce96edc2a4f3d191a6 not found: ID does not exist" Jul 09 22:28:39.944708 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lvrw\" (UniqueName: \"kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.944781 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944717 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.944781 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944746 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.944861 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944798 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.944861 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944815 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.944861 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944851 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs\") pod \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\" (UID: \"a8a413e5-9618-4497-8c6c-fddc2eb3342d\") " Jul 09 22:28:39.945027 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.944980 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:28:39.945089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.945066 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home" (OuterVolumeSpecName: "home") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:28:39.945089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.945073 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:28:39.945222 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.945186 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-model-cache\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:39.945222 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.945202 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-home\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:39.945222 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.945212 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tmp-dir\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:39.946895 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.946867 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm" (OuterVolumeSpecName: "dshm") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:28:39.946995 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.946923 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:28:39.946995 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:39.946953 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw" (OuterVolumeSpecName: "kube-api-access-8lvrw") pod "a8a413e5-9618-4497-8c6c-fddc2eb3342d" (UID: "a8a413e5-9618-4497-8c6c-fddc2eb3342d"). InnerVolumeSpecName "kube-api-access-8lvrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:28:40.045989 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.045966 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a413e5-9618-4497-8c6c-fddc2eb3342d-tls-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:40.045989 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.045986 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lvrw\" (UniqueName: \"kubernetes.io/projected/a8a413e5-9618-4497-8c6c-fddc2eb3342d-kube-api-access-8lvrw\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:40.046185 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.045995 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a413e5-9618-4497-8c6c-fddc2eb3342d-dshm\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\"" Jul 09 22:28:40.254092 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.254062 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:28:40.260232 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.260210 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-55e48b/test-model-55e48b-kserve-5d84549c87-r8gg2"] Jul 09 22:28:40.600200 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:28:40.600115 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" path="/var/lib/kubelet/pods/a8a413e5-9618-4497-8c6c-fddc2eb3342d/volumes" Jul 09 22:29:08.607031 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:08.606986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:08.871312 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:08.871239 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.424302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:09.424266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.800204 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:09.800167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.900635 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:09.900595 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:10.001969 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:10.001934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:10.182316 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:10.182210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:12.741300 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:12.741265 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:29:15.803118 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:15.803060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:15.924001 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:15.923968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.063482 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:16.063385 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.708435 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:16.708400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.015789 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:17.015714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.148183 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:17.148124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.277578 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.277545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.380699 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.380666 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.476292 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.476260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.792760 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.792734 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.893420 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.893392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.995594 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:20.995567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:24.829001 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:24.828967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:24.862867 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:24.862842 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:29:25.301589 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:25.301555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:25.638378 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:25.638296 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:25.786038 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:25.786006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:28.336812 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:28.336757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:28.434926 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:28.434889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:28.509950 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:28.509920 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:28.802460 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:28.802436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:29.006623 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:29.006583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:29.106404 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:29.106332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:32.838237 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:32.838200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:37.243450 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:37.243418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:29:40.971272 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:40.971240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:41.388283 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:41.388176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:41.495311 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:41.495284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:41.601237 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:41.601209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:41.868489 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:41.868457 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:47.616133 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:47.616093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:47.722302 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:47.722258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:47.748685 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:47.748662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:29:47.897532 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:47.897462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:48.326224 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:48.326189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:48.692703 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:48.692630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:48.865370 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:48.865342 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:48.963821 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:48.963799 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:49.166588 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:49.166558 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:54.238710 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:54.238678 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:54.381165 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:54.381106 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:55.194505 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:55.194465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:55.294355 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:55.294324 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:55.493293 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:55.493262 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:56.005501 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:56.005467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:56.325995 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:56.325906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:56.947558 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:56.947520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:57.949806 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:57.949766 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:29:59.519637 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:59.519604 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:59.619374 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:59.619345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:59.715864 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:59.715829 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:59.818483 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:29:59.818413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:00.110170 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:00.110070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:00.205288 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:00.205263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:04.005198 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:04.005102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:04.360364 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:04.360291 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:04.711490 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:04.711453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:04.919662 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:04.919631 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:07.568845 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:07.568812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:07.672381 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:07.672350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:07.770205 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:07.770173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:07.867258 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:07.867194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:30:07.925556 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:07.925529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:08.141034 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:08.140960 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:08.238781 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:08.238754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:12.089584 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:12.089550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:19.142075 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:19.142042 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:30:21.989985 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:21.989942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:22.090549 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:22.090520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:28.903167 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:28.903109 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:29.009958 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:29.009931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:35.831436 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:35.831400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:49.767351 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:30:49.767311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:31:10.579100 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:31:10.579074 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:31:10.589048 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:31:10.589028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcz29_a0780c58-9d73-4a0c-98b7-93b16484e686/ovn-acl-logging/0.log" Jul 09 22:31:47.861565 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:31:47.861484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:31:47.961707 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:31:47.961678 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:46.058412 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:32:46.058375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:17.129531 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:17.129498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:17.609451 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:17.609411 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:17.808106 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:17.808069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:17.909456 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:17.909356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:18.154599 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:18.154573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:21.344458 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:21.344427 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:33:23.234026 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:23.233988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:23.298313 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:23.298278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:23.490555 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:23.490473 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:23.876301 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:23.876226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:24.281030 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:24.280997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:24.386368 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:24.386336 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:24.486136 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:24.486113 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:24.678443 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:24.678368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:30.145009 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:30.144975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:30.207492 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:30.207468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:30.428985 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:30.428909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:32.551430 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:32.551394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kkslm"] Jul 09 22:33:36.592811 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:36.592781 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-shbmm_9ff633bb-e66c-45d4-a389-9c8ca38c563b/copy-manifests/0.log" Jul 09 22:33:36.604129 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:36.604097 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-shbmm_9ff633bb-e66c-45d4-a389-9c8ca38c563b/manager/0.log" Jul 09 22:33:38.526708 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:38.526677 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-862m4_e0965f0e-0587-45bd-8494-8d6893ad1767/manager/0.log" Jul 09 22:33:38.637272 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:38.637245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kkslm_8818947c-ee5a-464b-8d94-bb35c2621593/limitador/0.log" Jul 09 22:33:39.337624 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:39.337592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-c5thd_87985b5b-6071-4413-81cb-55bb7e2defea/kube-auth-proxy/0.log" Jul 09 22:33:40.484589 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:40.484550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bg4fd_efd3cbdf-5b96-44f7-a66f-5f8682b1ae85/main/0.log" Jul 09 22:33:40.707385 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:40.707357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w9nv2_15c96447-68bd-4270-a8f3-12c4ff163469/main/0.log" Jul 09 22:33:40.820299 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:40.820223 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-cgwq5_c5291d3e-7716-4606-91a8-eef90ea4a303/main/0.log" Jul 09 22:33:45.015262 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:45.015216 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:46.391287 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:46.391251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:48.519991 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:48.519965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hfnsm_486c6f74-a4fc-4bb1-bbed-6992239d6bf3/global-pull-secret-syncer/0.log" Jul 09 22:33:48.579587 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:48.579564 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5pr67_b8e53632-4f60-484c-9420-17fcf039bf28/konnectivity-agent/0.log" Jul 09 22:33:48.674691 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:48.674668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-173.ec2.internal_ee0b5653ffdcb1b1efc3d6a28d433ffd/haproxy/0.log" Jul 09 22:33:53.844235 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:53.844200 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-862m4_e0965f0e-0587-45bd-8494-8d6893ad1767/manager/0.log" Jul 09 22:33:53.869786 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:53.869739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kkslm_8818947c-ee5a-464b-8d94-bb35c2621593/limitador/0.log" Jul 09 22:33:55.688168 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.688121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-82plr_34ff5dac-867e-430f-8c75-b98753e385f1/cluster-monitoring-operator/0.log" Jul 09 22:33:55.720817 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.720790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zgxvd_38a1ffc7-f292-4192-9a9b-02681c10e7ec/kube-state-metrics/0.log" Jul 09 22:33:55.742705 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.742680 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zgxvd_38a1ffc7-f292-4192-9a9b-02681c10e7ec/kube-rbac-proxy-main/0.log" Jul 09 22:33:55.769409 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.769386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zgxvd_38a1ffc7-f292-4192-9a9b-02681c10e7ec/kube-rbac-proxy-self/0.log" Jul 09 22:33:55.804517 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.804491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67474fb59c-2dnpb_464fb9ee-0a26-4362-ad99-c61542c73fc6/metrics-server/0.log" Jul 09 22:33:55.844015 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:55.843949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lt59v_98d7b4a2-b78b-44f8-9374-eeb8d8f27a60/monitoring-plugin/0.log" Jul 09 22:33:56.016672 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.016650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rsqn_95d80e6b-7df6-431c-a69e-f8af095fb8a5/node-exporter/0.log" Jul 09 22:33:56.043188 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.043168 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rsqn_95d80e6b-7df6-431c-a69e-f8af095fb8a5/kube-rbac-proxy/0.log" Jul 09 22:33:56.067101 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.067083 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rsqn_95d80e6b-7df6-431c-a69e-f8af095fb8a5/init-textfile/0.log" Jul 09 22:33:56.262895 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.262875 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/prometheus/0.log" Jul 09 22:33:56.295554 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.295532 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/config-reloader/0.log" Jul 09 22:33:56.321040 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.321023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/thanos-sidecar/0.log" Jul 09 22:33:56.347965 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.347947 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/kube-rbac-proxy-web/0.log" Jul 09 22:33:56.370821 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.370803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/kube-rbac-proxy/0.log" Jul 09 22:33:56.395560 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.395545 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/kube-rbac-proxy-thanos/0.log" Jul 09 22:33:56.422862 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.422815 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_143bb82b-730d-4355-bf5d-f8e35760e2ca/init-config-reloader/0.log" Jul 09 22:33:56.509992 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:56.509973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-x5wdh_4e9907ae-675a-4977-89aa-4d864c33fe80/prometheus-operator-admission-webhook/0.log" Jul 09 22:33:58.572551 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.572522 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf"] Jul 09 22:33:58.573025 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.573006 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" containerName="main" Jul 09 22:33:58.573102 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.573030 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" containerName="main" Jul 09 22:33:58.573186 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.573177 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a413e5-9618-4497-8c6c-fddc2eb3342d" containerName="main" Jul 09 22:33:58.576589 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.576570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.579348 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.579330 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgg8m\"/\"kube-root-ca.crt\"" Jul 09 22:33:58.579438 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.579388 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgg8m\"/\"openshift-service-ca.crt\"" Jul 09 22:33:58.580329 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.580314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rgg8m\"/\"default-dockercfg-ctdb7\"" Jul 09 22:33:58.588884 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.588861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf"] Jul 09 22:33:58.708435 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.708409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-sys\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.708558 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.708462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-lib-modules\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.708558 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.708511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tnp\" (UniqueName: \"kubernetes.io/projected/f650e332-46d9-49e2-81e4-9c7398562d57-kube-api-access-q2tnp\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.708672 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.708557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-proc\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.708672 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.708580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-podres\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809807 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-sys\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-lib-modules\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tnp\" (UniqueName: \"kubernetes.io/projected/f650e332-46d9-49e2-81e4-9c7398562d57-kube-api-access-q2tnp\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-proc\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-sys\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.809907 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-podres\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.810075 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.809953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-lib-modules\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.814173 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.810364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-proc\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.814173 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.810470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f650e332-46d9-49e2-81e4-9c7398562d57-podres\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.821076 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.821055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tnp\" (UniqueName: \"kubernetes.io/projected/f650e332-46d9-49e2-81e4-9c7398562d57-kube-api-access-q2tnp\") pod \"perf-node-gather-daemonset-tglqf\" (UID: \"f650e332-46d9-49e2-81e4-9c7398562d57\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:58.886507 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:58.886458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:59.016417 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.016386 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf"] Jul 09 22:33:59.018708 ip-10-0-133-173 kubenswrapper[2564]: W0709 22:33:59.018675 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf650e332_46d9_49e2_81e4_9c7398562d57.slice/crio-40e40bd6ef33bc1accd8d45172fd44861f4dd7309887dde23c5347602ec489e0 WatchSource:0}: Error finding container 40e40bd6ef33bc1accd8d45172fd44861f4dd7309887dde23c5347602ec489e0: Status 404 returned error can't find the container with id 40e40bd6ef33bc1accd8d45172fd44861f4dd7309887dde23c5347602ec489e0 Jul 09 22:33:59.313061 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.313041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8895854b-h8zks_ad53f685-f918-45c9-b7dd-c6922c352f9d/console/0.log" Jul 09 22:33:59.342223 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.342195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" event={"ID":"f650e332-46d9-49e2-81e4-9c7398562d57","Type":"ContainerStarted","Data":"9c2fb81901bbb2dd605af658a518217b70ab332df113936566ba057d40c12435"} Jul 09 22:33:59.342323 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.342250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" event={"ID":"f650e332-46d9-49e2-81e4-9c7398562d57","Type":"ContainerStarted","Data":"40e40bd6ef33bc1accd8d45172fd44861f4dd7309887dde23c5347602ec489e0"} Jul 09 22:33:59.342396 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.342380 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:33:59.363653 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:33:59.363616 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" podStartSLOduration=1.36360372 podStartE2EDuration="1.36360372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:59.362483019 +0000 UTC m=+2569.339621599" watchObservedRunningTime="2026-07-09 22:33:59.36360372 +0000 UTC m=+2569.340742300" Jul 09 22:34:01.170095 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:01.170067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lz77_c43fee24-f3ff-445c-8956-da86cc6ad959/dns/0.log" Jul 09 22:34:01.223089 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:01.223065 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lz77_c43fee24-f3ff-445c-8956-da86cc6ad959/kube-rbac-proxy/0.log" Jul 09 22:34:01.350770 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:01.350751 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tlch_b85ef31c-336f-44ff-b5d5-44f95a8cd592/dns-node-resolver/0.log" Jul 09 22:34:02.027414 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:02.027380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tzjzm_b53b3852-033a-461c-97a4-0d6c3a74159a/node-ca/0.log" Jul 09 22:34:03.105818 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:03.105791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-c5thd_87985b5b-6071-4413-81cb-55bb7e2defea/kube-auth-proxy/0.log" Jul 09 22:34:04.032870 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:04.032836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdjv9_00c89e2e-9acc-4456-9ac4-7691f0bc6db7/serve-healthcheck-canary/0.log" Jul 09 22:34:04.647046 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:04.647015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dm69s_e2615e29-1f3e-49b4-8026-867906f11c4d/kube-rbac-proxy/0.log" Jul 09 22:34:04.667241 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:04.667220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dm69s_e2615e29-1f3e-49b4-8026-867906f11c4d/exporter/0.log" Jul 09 22:34:04.689778 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:04.689745 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dm69s_e2615e29-1f3e-49b4-8026-867906f11c4d/extractor/0.log" Jul 09 22:34:05.355911 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:05.355888 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-tglqf" Jul 09 22:34:07.403010 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:07.402979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-shbmm_9ff633bb-e66c-45d4-a389-9c8ca38c563b/manager/0.log" Jul 09 22:34:07.434256 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:07.434235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-shbmm_9ff633bb-e66c-45d4-a389-9c8ca38c563b/copy-manifests/0.log" Jul 09 22:34:08.687501 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:08.687466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b9cdbd59d-f4rms_53b77197-fc85-4e42-9f0c-3af0114a44f9/manager/0.log" Jul 09 22:34:09.190220 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:09.190196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-c5thd_87985b5b-6071-4413-81cb-55bb7e2defea/kube-auth-proxy/0.log" Jul 09 22:34:10.670344 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:10.670310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-c5thd_87985b5b-6071-4413-81cb-55bb7e2defea/kube-auth-proxy/0.log" Jul 09 22:34:14.047552 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:14.047522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g5f7d_455228f6-a497-4547-b7e6-304cc3d91bbf/migrator/0.log" Jul 09 22:34:14.070740 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:14.070713 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g5f7d_455228f6-a497-4547-b7e6-304cc3d91bbf/graceful-termination/0.log" Jul 09 22:34:15.705901 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.705876 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/kube-multus-additional-cni-plugins/0.log" Jul 09 22:34:15.726704 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.726684 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/egress-router-binary-copy/0.log" Jul 09 22:34:15.748473 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.748451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/cni-plugins/0.log" Jul 09 22:34:15.770782 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.770762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/bond-cni-plugin/0.log" Jul 09 22:34:15.793127 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.793107 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/routeoverride-cni/0.log" Jul 09 22:34:15.817589 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.817567 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/whereabouts-cni-bincopy/0.log" Jul 09 22:34:15.839653 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:15.839637 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8lc2_fe1d2ecf-648d-4d17-87fb-d31725c89939/whereabouts-cni/0.log" Jul 09 22:34:16.114514 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:16.114463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-psgpd_6a5232a8-afaf-44e9-9832-127894abb1b7/kube-multus/0.log" Jul 09 22:34:16.234465 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:16.234443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwvrl_2218784c-75ba-483b-9c4a-86e60c8a8be9/network-metrics-daemon/0.log" Jul 09 22:34:16.252772 ip-10-0-133-173 kubenswrapper[2564]: I0709 22:34:16.252750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwvrl_2218784c-75ba-483b-9c4a-86e60c8a8be9/kube-rbac-proxy/0.log"