Jul 21 14:57:22.057729 ip-10-0-129-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 14:57:22.057741 ip-10-0-129-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 14:57:22.057750 ip-10-0-129-25 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 14:57:22.058091 ip-10-0-129-25 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 14:57:32.281743 ip-10-0-129-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 14:57:32.281766 ip-10-0-129-25 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot db4a519667ea4f73bf8cbddcb36207e7 -- Jul 21 14:59:35.394539 ip-10-0-129-25 systemd[1]: Starting Kubernetes Kubelet... Jul 21 14:59:35.789426 ip-10-0-129-25 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:59:35.789426 ip-10-0-129-25 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 14:59:35.789426 ip-10-0-129-25 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:59:35.789426 ip-10-0-129-25 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 14:59:35.789426 ip-10-0-129-25 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:59:35.790126 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.789489 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796922 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796943 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796948 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796951 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796954 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.796946 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796956 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796960 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796962 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796965 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796967 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796971 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796974 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796977 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796980 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796982 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796985 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796987 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796990 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796993 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796995 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.796998 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797000 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797003 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797005 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797011 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.797178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797013 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797016 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797018 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797020 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797023 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797026 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797028 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797031 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797033 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797036 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797039 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797041 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797045 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797047 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797050 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797053 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797055 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797058 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797061 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797063 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.797666 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797066 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797068 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797071 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797074 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797076 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797079 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797082 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797084 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797087 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797089 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797091 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797094 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797096 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797099 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797103 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797107 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797110 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797113 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797116 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797118 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.798151 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797121 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797124 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797127 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797129 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797132 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797135 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797138 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797140 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797143 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797145 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797148 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797150 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797153 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797155 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797158 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797161 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797164 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797166 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797169 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.798655 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797171 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797174 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797177 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797179 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797182 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797184 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797189 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797192 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797196 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797200 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797202 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797205 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797208 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797210 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797213 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797947 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797954 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797957 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797961 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.799134 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797964 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797966 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797969 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797972 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797974 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797977 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797980 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797982 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797987 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797991 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797994 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.797997 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798000 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798003 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798006 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798009 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798011 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798014 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798016 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.799603 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798019 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798021 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798024 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798026 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798029 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798031 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798034 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798036 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798039 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798041 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798043 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798048 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798052 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798054 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798057 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798060 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798063 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798066 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798068 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798071 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.800063 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798074 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798078 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798081 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798083 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798085 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798088 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798090 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798093 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798096 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798098 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798101 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798103 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798106 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798108 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798111 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798114 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798116 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798119 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798121 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798124 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.800560 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798127 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798130 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798133 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798137 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798139 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798142 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798144 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798147 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798149 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798152 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798154 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798157 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798159 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798162 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798165 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798167 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798170 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798173 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798175 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.801054 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798178 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798180 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798183 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798185 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798188 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798190 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798193 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798195 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798198 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798201 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798203 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798205 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798208 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798211 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798213 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798215 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798218 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798649 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798655 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798659 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.801530 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798662 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798665 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798668 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798670 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798673 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798675 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798678 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798680 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798683 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798685 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798688 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798690 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798693 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798696 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798699 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798701 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798704 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798706 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798708 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.802009 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798711 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798714 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798716 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798719 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798721 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798725 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798728 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798731 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798734 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798737 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798739 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798742 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798744 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798747 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798749 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798752 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798754 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798757 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798759 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798762 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.802496 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798764 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798767 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798769 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798771 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798774 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798777 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798779 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798782 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798784 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798787 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798789 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798792 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798794 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798800 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798802 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798805 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798807 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798809 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798812 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798814 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.802964 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798817 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798820 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798822 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798825 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798828 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798830 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798832 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798835 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798837 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798840 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798842 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798845 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798847 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798849 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798854 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798858 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798861 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798864 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798867 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798870 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.803507 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798873 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798876 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798879 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798881 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798884 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798888 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798891 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798893 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798896 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798898 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798901 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798904 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798908 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798912 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798915 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798917 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.798920 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.798989 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799000 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799007 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 14:59:35.804007 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799014 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799020 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799025 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799031 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799038 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799041 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799044 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799048 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799051 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799053 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799056 2585 flags.go:64] FLAG: --cgroup-root="" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799059 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799062 2585 flags.go:64] FLAG: --client-ca-file="" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799067 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799070 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799074 2585 flags.go:64] FLAG: --cluster-domain="" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799076 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799081 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799083 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799087 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799091 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799094 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799097 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 14:59:35.804524 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799100 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799103 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799107 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799110 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799113 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799116 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799119 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799122 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799125 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799128 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799130 2585 flags.go:64] FLAG: --enable-server="true" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799133 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799138 2585 flags.go:64] FLAG: --event-burst="100" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799141 2585 flags.go:64] FLAG: --event-qps="50" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799144 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799147 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799150 2585 flags.go:64] FLAG: --eviction-hard="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799154 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799157 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799159 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799162 2585 flags.go:64] FLAG: --eviction-soft="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799165 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799168 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799172 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799175 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 14:59:35.805059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799178 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799182 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799185 2585 flags.go:64] FLAG: --feature-gates="" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799191 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799194 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799197 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799200 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799203 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799206 2585 flags.go:64] FLAG: --help="false" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799211 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-129-25.ec2.internal" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799213 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799216 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799219 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799222 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799225 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799228 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799231 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799234 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799236 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799239 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799242 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799258 2585 flags.go:64] FLAG: --kube-reserved="" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799261 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799264 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 14:59:35.805673 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799267 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799270 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799273 2585 flags.go:64] FLAG: --lock-file="" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799276 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799278 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799281 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799286 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799290 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799293 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799298 2585 flags.go:64] FLAG: --logging-format="text" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799300 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799304 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799306 2585 flags.go:64] FLAG: --manifest-url="" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799309 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799313 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799316 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799320 2585 flags.go:64] FLAG: --max-pods="110" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799324 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799327 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799330 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799333 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799336 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799339 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799342 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799349 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 14:59:35.806239 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799352 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799355 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799358 2585 flags.go:64] FLAG: --pod-cidr="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799361 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799367 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799370 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799373 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799376 2585 flags.go:64] FLAG: --port="10250" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799379 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799382 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd54e66abce087f0" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799385 2585 flags.go:64] FLAG: --qos-reserved="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799388 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799390 2585 flags.go:64] FLAG: --register-node="true" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799393 2585 flags.go:64] FLAG: --register-with-taints="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799396 2585 flags.go:64] FLAG: --registry-burst="10" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799400 2585 flags.go:64] FLAG: --registry-qps="5" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799404 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799406 2585 flags.go:64] FLAG: --reserved-memory="" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799410 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799413 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799416 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799419 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799422 2585 flags.go:64] FLAG: --runonce="false" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799424 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799427 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 14:59:35.806879 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799431 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799434 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799437 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799440 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799443 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799446 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799448 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799451 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799454 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799457 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799460 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799462 2585 flags.go:64] FLAG: --system-cgroups="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799465 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799470 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799473 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799476 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799479 2585 flags.go:64] FLAG: --tls-min-version="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799482 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799485 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799488 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799490 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799493 2585 flags.go:64] FLAG: --v="2" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799497 2585 flags.go:64] FLAG: --version="false" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799503 2585 flags.go:64] FLAG: --vmodule="" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799507 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 14:59:35.807593 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.799510 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799628 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799632 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799635 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799639 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799642 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799645 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799649 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799652 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799655 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799658 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799661 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799664 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799667 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799669 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799672 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799674 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799677 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799680 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.808178 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799683 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799685 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799688 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799691 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799694 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799697 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799699 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799702 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799705 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799707 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799710 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799714 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799717 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799719 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799722 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799725 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799729 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799732 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799735 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799737 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.808649 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799741 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799743 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799746 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799748 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799751 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799753 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799756 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799759 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799761 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799764 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799766 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799768 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799771 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799773 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799775 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799778 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799780 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799783 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799785 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799788 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.809124 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799790 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799793 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799795 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799799 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799801 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799804 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799807 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799809 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799812 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799814 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799817 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799819 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799824 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799827 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799830 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799833 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799836 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799838 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799841 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799844 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.809597 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799847 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799849 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799853 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799856 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799859 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799862 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799865 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799868 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799870 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799873 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799875 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799878 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799880 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799883 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799885 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799890 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799892 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799895 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799898 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.810082 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799900 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.799903 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.800501 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.807276 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.807293 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.808050 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.808057 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808114 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808120 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808123 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808126 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808129 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808132 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808134 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808137 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.810568 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808140 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808142 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808145 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808147 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808150 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808152 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808155 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808157 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808160 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808162 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808165 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808167 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808170 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808172 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808175 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808177 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808180 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808183 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808186 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808189 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.810944 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808192 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808195 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808198 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808202 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808205 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808208 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808210 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808213 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808216 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808219 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808221 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808224 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808227 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808229 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808232 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808234 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808237 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808240 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808258 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.811503 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808262 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808265 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808268 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808271 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808274 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808276 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808279 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808281 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808284 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808286 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808290 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808292 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808295 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808298 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808300 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808304 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808306 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808309 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808311 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808314 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.811970 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808317 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808321 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808324 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808327 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808330 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808333 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808336 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808339 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808341 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808344 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808347 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808349 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808352 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808354 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808357 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808359 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808362 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808364 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808367 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.812448 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808370 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808372 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808375 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808377 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808380 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808383 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808385 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808388 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808390 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808393 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808395 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808398 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808400 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.808405 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808516 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:59:35.812898 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808521 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808524 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808527 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808530 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808532 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808535 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808538 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808541 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808543 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808546 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808548 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808551 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808553 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808556 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808558 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808560 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808563 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808565 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808568 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808570 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:59:35.813267 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808573 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808575 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808578 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808580 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808583 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808585 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808588 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808591 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808593 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808596 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808598 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808601 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808603 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808606 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808608 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808611 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808613 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808616 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808618 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808620 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:59:35.813756 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808623 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808625 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808628 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808630 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808632 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808635 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808637 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808640 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808642 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808645 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808648 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808652 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808655 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808658 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808660 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808663 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808666 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808668 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808671 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808673 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:59:35.814229 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808676 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808679 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808681 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808684 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808686 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808689 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808691 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808694 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808696 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808698 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808701 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808703 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808706 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808708 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808710 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808713 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808715 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808718 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808720 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808723 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:59:35.814730 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808725 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808728 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808730 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808733 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808735 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808738 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808742 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808745 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808748 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808751 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808753 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808756 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808760 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808763 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808766 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808769 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808773 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:59:35.815191 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:35.808775 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.808780 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.808888 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.811007 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.812401 2585 server.go:1019] "Starting client certificate rotation" Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.812506 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.812545 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:59:35.815660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.814787 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:59:35.820173 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.820151 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:59:35.833271 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.833238 2585 log.go:25] "Validated CRI v1 runtime API" Jul 21 14:59:35.835267 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.835237 2585 log.go:25] "Validated CRI v1 image API" Jul 21 14:59:35.836678 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.836666 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 14:59:35.840447 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.840425 2585 fs.go:135] Filesystem UUIDs: map[01e89222-0baa-4d19-aaef-b7c3bab0b6c8:/dev/nvme0n1p3 218968e7-9dac-4895-bbc5-ed8769cc68fc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 21 14:59:35.840505 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.840446 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 14:59:35.845525 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.845393 2585 manager.go:216] Machine: {Timestamp:2026-07-21 14:59:35.844078153 +0000 UTC m=+0.334232337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098845 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d7029fd099a09b06d14fc41ff7ce SystemUUID:ec20d702-9fd0-99a0-9b06-d14fc41ff7ce BootID:db4a5196-67ea-4f73-bf8c-bddcb36207e7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:74:8b:14:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:74:8b:14:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:82:74:ee:43:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 14:59:35.845525 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.845519 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 14:59:35.845660 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.845600 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 14:59:35.848104 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.848086 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:59:35.848316 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.848287 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 14:59:35.848479 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.848322 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 14:59:35.849511 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.849499 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 14:59:35.849575 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.849517 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 14:59:35.849575 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.849529 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:59:35.850216 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.850202 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:59:35.851711 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.851699 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 14:59:35.854799 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.854785 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:59:35.854934 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.854923 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 14:59:35.854989 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.854961 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 21 14:59:35.854989 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.854975 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 14:59:35.855076 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.854994 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 14:59:35.855076 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.855008 2585 kubelet.go:398] "Adding apiserver pod source" Jul 21 14:59:35.855076 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.855020 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 14:59:35.855443 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.855419 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:59:35.855518 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.855444 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:59:35.858124 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.858099 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 14:59:35.860089 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.860076 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 14:59:35.860155 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.860107 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 14:59:35.861723 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861711 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 14:59:35.861758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861733 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 14:59:35.861758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861743 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 14:59:35.861758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861749 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 14:59:35.861758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861758 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861763 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861771 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861777 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861785 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861794 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861804 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 14:59:35.861861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.861809 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 14:59:35.862672 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.862660 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 14:59:35.862703 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.862673 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 14:59:35.865360 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.865340 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 14:59:35.865761 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.865746 2585 server.go:1268] "Started kubelet" Jul 21 14:59:35.869196 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.865830 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 14:59:35.869306 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.869173 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 14:59:35.869306 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.869200 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 14:59:35.869306 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.869280 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 14:59:35.869826 ip-10-0-129-25 systemd[1]: Started Kubernetes Kubelet. Jul 21 14:59:35.870060 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.870040 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 14:59:35.871203 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.871174 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mczp8" Jul 21 14:59:35.871808 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.871791 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 14:59:35.872725 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.872705 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 21 14:59:35.875675 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.874428 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-25.ec2.internal.18c4560f414e7d5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-25.ec2.internal,UID:ip-10-0-129-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-25.ec2.internal,},FirstTimestamp:2026-07-21 14:59:35.865720157 +0000 UTC m=+0.355874340,LastTimestamp:2026-07-21 14:59:35.865720157 +0000 UTC m=+0.355874340,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-25.ec2.internal,}" Jul 21 14:59:35.876234 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.876216 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 14:59:35.880072 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.880057 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mczp8" Jul 21 14:59:35.880586 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.880564 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 14:59:35.880758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.880677 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 14:59:35.880758 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.880730 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:35.881452 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881382 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 14:59:35.881452 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881506 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 14:59:35.881452 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881522 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 14:59:35.881750 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881602 2585 factory.go:55] Registering systemd factory Jul 21 14:59:35.881750 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881608 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 21 14:59:35.881750 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881615 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 21 14:59:35.881750 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.881616 2585 factory.go:223] Registration of the systemd container factory successfully Jul 21 14:59:35.882178 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.882161 2585 factory.go:153] Registering CRI-O factory Jul 21 14:59:35.882178 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.882180 2585 factory.go:223] Registration of the crio container factory successfully Jul 21 14:59:35.882331 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.882234 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 14:59:35.882331 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.882278 2585 factory.go:103] Registering Raw factory Jul 21 14:59:35.882331 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.882295 2585 manager.go:1196] Started watching for new ooms in manager Jul 21 14:59:35.883360 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.883344 2585 manager.go:349] Starting recovery of all containers Jul 21 14:59:35.883446 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.883426 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 14:59:35.883510 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.883481 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 14:59:35.893821 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.893801 2585 manager.go:354] Recovery completed Jul 21 14:59:35.898234 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.898221 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:35.900580 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.900561 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:35.900648 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.900594 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:35.900648 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.900608 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:35.901079 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901066 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 14:59:35.901079 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901077 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 14:59:35.901167 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901093 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:59:35.901167 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901125 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:35.901846 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901831 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:35.901908 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901859 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:35.901908 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.901872 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:35.902383 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.902370 2585 policy_none.go:49] "None policy: Start" Jul 21 14:59:35.902439 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.902400 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 14:59:35.902439 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.902422 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 14:59:35.903620 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.903608 2585 policy_none.go:47] "Start" Jul 21 14:59:35.952431 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952416 2585 manager.go:337] "Starting Device Plugin manager" Jul 21 14:59:35.952505 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.952448 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 14:59:35.952505 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952459 2585 server.go:87] "Starting device plugin registration server" Jul 21 14:59:35.952735 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952723 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 14:59:35.952777 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952736 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 14:59:35.952863 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952847 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 14:59:35.952986 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952933 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 14:59:35.952986 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:35.952943 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 14:59:35.953438 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.953414 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 14:59:35.953521 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:35.953468 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.053946 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.053733 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:36.055222 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.054813 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:36.055222 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.054851 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:36.055222 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.054863 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:36.055222 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.054889 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.058687 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.058666 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 14:59:36.059954 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.059935 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 14:59:36.060011 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.059978 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 14:59:36.060011 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.060004 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 14:59:36.060087 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.060041 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 14:59:36.062739 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.062717 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:59:36.063777 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.063764 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.063822 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.063785 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-25.ec2.internal\": node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.115206 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.115178 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.160338 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.160306 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal"] Jul 21 14:59:36.160416 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.160381 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:36.162236 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.162220 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:36.162324 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.162273 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:36.162324 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.162284 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:36.164021 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164008 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:36.164103 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164089 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.164141 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164137 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:36.164719 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164705 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:36.164719 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164713 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:36.164861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164725 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:36.164861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164738 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:36.164861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164753 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:36.164861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.164739 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:36.166205 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.166191 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.166273 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.166219 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:59:36.166913 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.166896 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:59:36.166985 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.166929 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:59:36.166985 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.166942 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:59:36.183497 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.183473 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.183592 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.183500 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26be7d37844b0dd9eb51bca7acab6c5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"d26be7d37844b0dd9eb51bca7acab6c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.183592 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.183517 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.191001 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.190979 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.195383 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.195349 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.215516 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.215486 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.283976 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.283945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26be7d37844b0dd9eb51bca7acab6c5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"d26be7d37844b0dd9eb51bca7acab6c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.283976 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.283974 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.284189 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.283997 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.284189 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.284047 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.284189 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.284062 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26be7d37844b0dd9eb51bca7acab6c5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"d26be7d37844b0dd9eb51bca7acab6c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.284189 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.284114 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d173b50314f2a30cea0c002ada420dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"d173b50314f2a30cea0c002ada420dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.315836 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.315773 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.416635 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.416600 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.494066 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.494029 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.497714 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:36.497694 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:36.516916 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.516896 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:36.617532 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:36.617449 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:38.205847 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:38.205823 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:38.300453 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.300425 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 14:59:38.300841 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.300589 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 14:59:38.306721 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:38.306700 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:38.327383 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.327362 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:59:38.377249 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.377174 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:54:37 +0000 UTC" deadline="2028-04-03 07:42:23.123018172 +0000 UTC" Jul 21 14:59:38.377249 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.377204 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14920h42m44.74581883s" Jul 21 14:59:38.407373 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:38.407351 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 21 14:59:38.451404 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.451373 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:59:38.496610 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.496577 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:59:38.569525 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.569490 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 21 14:59:38.579902 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.579878 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:59:38.580752 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.580737 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 21 14:59:38.590731 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.590709 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:59:38.702280 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:38.702246 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd173b50314f2a30cea0c002ada420dae.slice/crio-de14d7c26083dd7c014edb1da8ac977f0639cf7e6f9c68c0a3c435096d0e7f07 WatchSource:0}: Error finding container de14d7c26083dd7c014edb1da8ac977f0639cf7e6f9c68c0a3c435096d0e7f07: Status 404 returned error can't find the container with id de14d7c26083dd7c014edb1da8ac977f0639cf7e6f9c68c0a3c435096d0e7f07 Jul 21 14:59:38.702521 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:38.702508 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26be7d37844b0dd9eb51bca7acab6c5.slice/crio-856edf1fb1c89aea25aed5ce2df5814c97a6d98a65a5b01e49665187a056dd47 WatchSource:0}: Error finding container 856edf1fb1c89aea25aed5ce2df5814c97a6d98a65a5b01e49665187a056dd47: Status 404 returned error can't find the container with id 856edf1fb1c89aea25aed5ce2df5814c97a6d98a65a5b01e49665187a056dd47 Jul 21 14:59:38.710978 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:38.710964 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:59:39.108300 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.108220 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:59:39.343936 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.343674 2585 apiserver.go:52] "Watching apiserver" Jul 21 14:59:39.356782 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.356750 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 14:59:39.358456 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.358394 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tm8wg","openshift-network-diagnostics/network-check-target-kdph4","kube-system/global-pull-secret-syncer-2x2bm","kube-system/konnectivity-agent-5t6sc","kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal","openshift-image-registry/node-ca-875xh","openshift-multus/multus-4tkxr","openshift-multus/network-metrics-daemon-kvkmn","openshift-network-operator/iptables-alerter-6l6p2","openshift-ovn-kubernetes/ovnkube-node-6wzkb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9","openshift-cluster-node-tuning-operator/tuned-thl6k","openshift-dns/node-resolver-h54f7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal"] Jul 21 14:59:39.359947 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.359918 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.361992 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.361567 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.362613 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.362594 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.362838 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.362804 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 14:59:39.363040 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363027 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.363457 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363187 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wc5m\"" Jul 21 14:59:39.363457 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363254 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.363457 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363317 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 14:59:39.363457 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.363349 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:39.363676 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363643 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 14:59:39.363733 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363706 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.363944 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363928 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qjstg\"" Jul 21 14:59:39.364002 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.363951 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.364521 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.364505 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.366126 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.366102 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.366291 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.366267 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:39.366987 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.366969 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 14:59:39.367080 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.366992 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6ftlf\"" Jul 21 14:59:39.367080 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.366994 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 14:59:39.368170 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.367616 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.368823 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.368806 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 14:59:39.369527 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.369507 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.370871 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.370241 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.370871 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.370357 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5t5n7\"" Jul 21 14:59:39.370871 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.370451 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 14:59:39.370871 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.370555 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.371817 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.371798 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.371891 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.371819 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 14:59:39.372097 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.372079 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.372213 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.372101 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmq5k\"" Jul 21 14:59:39.372213 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.372136 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.373589 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.373569 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:39.373671 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.373636 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:39.374306 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.374285 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qtm5r\"" Jul 21 14:59:39.374679 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.374660 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.374932 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.374915 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.375331 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.375312 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.376610 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.376593 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.377758 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.377741 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 14:59:39.377850 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.377762 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 14:59:39.377966 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.377947 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.378504 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.378486 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.378725 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.378702 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 14:59:39.378807 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.378781 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jxxxb\"" Jul 21 14:59:39.378963 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.378946 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 14:59:39.379031 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.379002 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 14:59:39.379124 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.378954 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.381135 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.381116 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 14:59:39.381595 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.381576 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9g589\"" Jul 21 14:59:39.382227 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382137 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 14:59:39.382405 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382392 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:59:39.382575 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382559 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-29vqq\"" Jul 21 14:59:39.382785 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382767 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-conf-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.382862 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382799 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-serviceca\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.382862 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382824 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/707069d9-bb46-4bd3-b971-7ad258eb89bc-agent-certs\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382858 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/707069d9-bb46-4bd3-b971-7ad258eb89bc-konnectivity-ca\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382882 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cni-binary-copy\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382906 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-bin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382927 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-daemon-config\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382958 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-host\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.382983 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383007 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-tmp-dir\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.383033 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383030 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-netns\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383052 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-etc-kubernetes\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383081 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383107 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-device-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ww9\" (UniqueName: \"kubernetes.io/projected/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-kube-api-access-h9ww9\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383184 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db06f20d-d5a9-41e7-a9e8-41b96d311c97-host-slash\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383207 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383229 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-os-release\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383261 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383285 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db06f20d-d5a9-41e7-a9e8-41b96d311c97-iptables-alerter-script\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-hosts-file\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-kubelet\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383351 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-kubelet-config\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383382 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzlz\" (UniqueName: \"kubernetes.io/projected/db06f20d-d5a9-41e7-a9e8-41b96d311c97-kube-api-access-6zzlz\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383429 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-multus\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.383481 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383462 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383488 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383512 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383536 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vw4\" (UniqueName: \"kubernetes.io/projected/8529b685-aecf-4eeb-a3cd-538037c7732e-kube-api-access-28vw4\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383561 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5q6\" (UniqueName: \"kubernetes.io/projected/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-kube-api-access-mk5q6\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383586 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-k8s-cni-cncf-io\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383608 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-hostroot\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383631 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-multus-certs\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383667 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqstd\" (UniqueName: \"kubernetes.io/projected/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-kube-api-access-fqstd\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-dbus\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383713 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-system-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383736 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cnibin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383763 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-socket-dir-parent\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.384275 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.383786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcdj\" (UniqueName: \"kubernetes.io/projected/494cf10a-fb83-463f-bced-3c325c91952b-kube-api-access-xmcdj\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.384708 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.384324 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:59:39.404761 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.404734 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ck84" Jul 21 14:59:39.412259 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.412238 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ck84" Jul 21 14:59:39.470527 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.470495 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 14:59:39.484382 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-hostroot\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.484523 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-multus-certs\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.484523 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-dbus\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.484523 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484445 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-kubernetes\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.484523 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484465 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-lib-modules\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.484523 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484540 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcdj\" (UniqueName: \"kubernetes.io/projected/494cf10a-fb83-463f-bced-3c325c91952b-kube-api-access-xmcdj\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484568 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484592 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-ovn\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysconfig\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484647 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-tuned\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484673 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-daemon-config\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484706 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-host\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484731 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.484774 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484756 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484781 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-config\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484806 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-host\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484827 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-tmp\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484850 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzshc\" (UniqueName: \"kubernetes.io/projected/03ed4b0b-5b21-46f3-af53-e2a25411b977-kube-api-access-vzshc\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-netns\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484897 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-device-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.484971 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-log-socket\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485003 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db06f20d-d5a9-41e7-a9e8-41b96d311c97-host-slash\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485053 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485083 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-modprobe-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485107 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-systemd\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485131 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db06f20d-d5a9-41e7-a9e8-41b96d311c97-iptables-alerter-script\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-hosts-file\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.485215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485201 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-kubelet\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485226 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-kubelet-config\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-systemd-units\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485285 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-systemd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzlz\" (UniqueName: \"kubernetes.io/projected/db06f20d-d5a9-41e7-a9e8-41b96d311c97-kube-api-access-6zzlz\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485353 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485376 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-env-overrides\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485401 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-script-lib\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vw4\" (UniqueName: \"kubernetes.io/projected/8529b685-aecf-4eeb-a3cd-538037c7732e-kube-api-access-28vw4\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485483 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5q6\" (UniqueName: \"kubernetes.io/projected/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-kube-api-access-mk5q6\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485509 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqstd\" (UniqueName: \"kubernetes.io/projected/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-kube-api-access-fqstd\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485533 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-slash\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485586 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-var-lib-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485613 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5a674ac-0885-4138-baca-c274f4f7b94e-ovn-node-metrics-cert\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485639 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-var-lib-kubelet\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kngx8\" (UniqueName: \"kubernetes.io/projected/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-kube-api-access-kngx8\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485698 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-system-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486022 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485721 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cnibin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485748 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-socket-dir-parent\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-netd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485819 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-sys\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485878 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-conf-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485929 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-serviceca\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485964 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-bin\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.485988 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-run\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/707069d9-bb46-4bd3-b971-7ad258eb89bc-agent-certs\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/707069d9-bb46-4bd3-b971-7ad258eb89bc-konnectivity-ca\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486093 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cni-binary-copy\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-bin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486166 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z79fm\" (UniqueName: \"kubernetes.io/projected/f5a674ac-0885-4138-baca-c274f4f7b94e-kube-api-access-z79fm\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.486856 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486196 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-tmp-dir\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-etc-kubernetes\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486254 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486281 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ww9\" (UniqueName: \"kubernetes.io/projected/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-kube-api-access-h9ww9\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-netns\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486338 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-system-cni-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486390 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-os-release\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486422 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486450 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-conf\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486475 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-etc-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486499 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-node-log\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486526 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-os-release\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486555 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-multus\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486608 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486648 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.487611 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486675 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-kubelet\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486700 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-cnibin\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486728 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-k8s-cni-cncf-io\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486813 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-k8s-cni-cncf-io\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-hostroot\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.486901 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-multus-certs\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.487113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-dbus\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488025 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-daemon-config\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488105 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-host\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.488213 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:39.488402 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.488275 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:39.988255025 +0000 UTC m=+2.990509405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:39.488894 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488523 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-run-netns\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.488894 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488580 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-device-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.488894 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488645 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db06f20d-d5a9-41e7-a9e8-41b96d311c97-host-slash\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.488894 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.488741 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.489216 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489188 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-system-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.489326 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489265 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cnibin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.489326 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489272 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db06f20d-d5a9-41e7-a9e8-41b96d311c97-iptables-alerter-script\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.489409 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489320 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-socket-dir-parent\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.489409 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489330 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-hosts-file\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.489409 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489377 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-kubelet\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.489663 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.489640 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-conf-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.490120 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.490101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-serviceca\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.490471 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.490439 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 14:59:39.491081 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491058 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/707069d9-bb46-4bd3-b971-7ad258eb89bc-konnectivity-ca\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.491190 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491171 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-multus\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491251 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491210 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-cni-binary-copy\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491251 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491233 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.491355 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491303 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.491411 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491358 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92ad084b-b180-4f42-b401-785ee1b6b965-kubelet-config\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.491411 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491367 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-multus-cni-dir\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491510 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-os-release\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491510 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491448 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.491616 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491533 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-etc-kubernetes\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491616 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/494cf10a-fb83-463f-bced-3c325c91952b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.491616 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491580 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-host-var-lib-cni-bin\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.491616 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.491606 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:39.491810 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.491655 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:39.991637892 +0000 UTC m=+2.993892261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:39.491810 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.491674 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-tmp-dir\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.494477 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.494419 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/707069d9-bb46-4bd3-b971-7ad258eb89bc-agent-certs\") pod \"konnectivity-agent-5t6sc\" (UID: \"707069d9-bb46-4bd3-b971-7ad258eb89bc\") " pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.495929 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.495890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcdj\" (UniqueName: \"kubernetes.io/projected/494cf10a-fb83-463f-bced-3c325c91952b-kube-api-access-xmcdj\") pod \"aws-ebs-csi-driver-node-x4jq9\" (UID: \"494cf10a-fb83-463f-bced-3c325c91952b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.500027 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.499999 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vw4\" (UniqueName: \"kubernetes.io/projected/8529b685-aecf-4eeb-a3cd-538037c7732e-kube-api-access-28vw4\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.500979 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.500957 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqstd\" (UniqueName: \"kubernetes.io/projected/deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd-kube-api-access-fqstd\") pod \"multus-4tkxr\" (UID: \"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd\") " pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.501785 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.501580 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5q6\" (UniqueName: \"kubernetes.io/projected/c68ffdc1-d2af-4ab9-bd1b-50458cb0287a-kube-api-access-mk5q6\") pod \"node-resolver-h54f7\" (UID: \"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a\") " pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.502345 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.502309 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ww9\" (UniqueName: \"kubernetes.io/projected/29ffa9eb-a8ab-4500-a6d7-2b2958b12da4-kube-api-access-h9ww9\") pod \"node-ca-875xh\" (UID: \"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4\") " pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.502545 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.502500 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzlz\" (UniqueName: \"kubernetes.io/projected/db06f20d-d5a9-41e7-a9e8-41b96d311c97-kube-api-access-6zzlz\") pod \"iptables-alerter-6l6p2\" (UID: \"db06f20d-d5a9-41e7-a9e8-41b96d311c97\") " pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.554252 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.554180 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"d26be7d37844b0dd9eb51bca7acab6c5","Type":"ContainerStarted","Data":"856edf1fb1c89aea25aed5ce2df5814c97a6d98a65a5b01e49665187a056dd47"} Jul 21 14:59:39.555620 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.555594 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"d173b50314f2a30cea0c002ada420dae","Type":"ContainerStarted","Data":"de14d7c26083dd7c014edb1da8ac977f0639cf7e6f9c68c0a3c435096d0e7f07"} Jul 21 14:59:39.587130 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-modprobe-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587130 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587127 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-systemd\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587161 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-systemd-units\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-systemd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587212 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-env-overrides\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587235 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-script-lib\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-slash\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587282 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-var-lib-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5a674ac-0885-4138-baca-c274f4f7b94e-ovn-node-metrics-cert\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-var-lib-kubelet\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587366 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kngx8\" (UniqueName: \"kubernetes.io/projected/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-kube-api-access-kngx8\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-netd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587400 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587424 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-sys\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587449 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587498 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-bin\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-run\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z79fm\" (UniqueName: \"kubernetes.io/projected/f5a674ac-0885-4138-baca-c274f4f7b94e-kube-api-access-z79fm\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587597 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-netns\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587622 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-system-cni-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587673 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-conf\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-etc-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-node-log\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587742 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-os-release\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.587787 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-kubelet\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587805 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-cnibin\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587834 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-kubernetes\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587856 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-lib-modules\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587909 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-ovn\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysconfig\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.587987 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-tuned\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588024 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588049 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-config\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588071 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-host\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588093 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-tmp\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzshc\" (UniqueName: \"kubernetes.io/projected/03ed4b0b-5b21-46f3-af53-e2a25411b977-kube-api-access-vzshc\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588161 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-log-socket\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.588622 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588186 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.589354 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588767 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.589354 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588905 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-modprobe-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.589354 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588954 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-systemd\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.589354 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.588993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-systemd-units\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.589354 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-systemd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.589591 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589454 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-env-overrides\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-script-lib\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589928 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-ovn\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589934 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-conf\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589975 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysconfig\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.589978 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-slash\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590319 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590007 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-var-lib-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590364 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590375 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-host\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-run-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590427 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-etc-openvswitch\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590497 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-node-log\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590553 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-os-release\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590588 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-kubelet\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590624 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-cnibin\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.590688 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590666 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-kubernetes\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591117 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590763 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-lib-modules\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591117 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590858 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5a674ac-0885-4138-baca-c274f4f7b94e-ovnkube-config\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591117 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.590913 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-log-socket\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591117 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591054 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.591117 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591106 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-var-lib-kubelet\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591377 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591281 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-netd\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591377 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-cni-bin\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591482 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591383 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-sysctl-d\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591482 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591407 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-run\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591482 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591432 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-sys\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.591482 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591447 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591672 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591490 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-run-netns\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591672 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5a674ac-0885-4138-baca-c274f4f7b94e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.591672 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.591638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03ed4b0b-5b21-46f3-af53-e2a25411b977-system-cni-dir\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.593610 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.593193 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-tmp\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.593610 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.593458 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5a674ac-0885-4138-baca-c274f4f7b94e-ovn-node-metrics-cert\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.593914 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.593892 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-etc-tuned\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.595345 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.595325 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03ed4b0b-5b21-46f3-af53-e2a25411b977-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.600573 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.600546 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzshc\" (UniqueName: \"kubernetes.io/projected/03ed4b0b-5b21-46f3-af53-e2a25411b977-kube-api-access-vzshc\") pod \"multus-additional-cni-plugins-tm8wg\" (UID: \"03ed4b0b-5b21-46f3-af53-e2a25411b977\") " pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.603351 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.603028 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:39.603351 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.603052 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:39.603351 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.603064 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:39.603351 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.603127 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:40.103109695 +0000 UTC m=+3.105364062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:39.605499 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.605473 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z79fm\" (UniqueName: \"kubernetes.io/projected/f5a674ac-0885-4138-baca-c274f4f7b94e-kube-api-access-z79fm\") pod \"ovnkube-node-6wzkb\" (UID: \"f5a674ac-0885-4138-baca-c274f4f7b94e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.605701 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.605679 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kngx8\" (UniqueName: \"kubernetes.io/projected/2b4ae65e-7aa2-49de-a6cc-c08895ae1732-kube-api-access-kngx8\") pod \"tuned-thl6k\" (UID: \"2b4ae65e-7aa2-49de-a6cc-c08895ae1732\") " pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.677057 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.676967 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tkxr" Jul 21 14:59:39.690256 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.690229 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" Jul 21 14:59:39.702315 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.702108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:39.712132 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.712106 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-875xh" Jul 21 14:59:39.722322 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.722299 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l6p2" Jul 21 14:59:39.731423 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.731374 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h54f7" Jul 21 14:59:39.737468 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.737446 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 14:59:39.744746 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.744724 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" Jul 21 14:59:39.754491 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.754468 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thl6k" Jul 21 14:59:39.991809 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.991727 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:39.991809 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:39.991773 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:39.991994 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.991854 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:39.991994 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.991925 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:40.991908701 +0000 UTC m=+3.994163065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:39.991994 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.991934 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:39.992112 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:39.991997 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:40.991976549 +0000 UTC m=+3.994230920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:40.192529 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.192493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:40.192707 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.192680 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:40.192707 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.192707 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:40.192814 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.192721 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:40.192814 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.192780 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:41.192763764 +0000 UTC m=+4.195018128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:40.415405 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.415368 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:54:39 +0000 UTC" deadline="2028-02-05 19:50:30.606907698 +0000 UTC" Jul 21 14:59:40.415405 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.415401 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13540h50m50.191510451s" Jul 21 14:59:40.548285 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.548257 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:40.548447 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.548362 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:40.593624 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.593505 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68ffdc1_d2af_4ab9_bd1b_50458cb0287a.slice/crio-1744921a8ecf0b2218af856ac0854b6d34f52e4b69d592f093c05cd256d04f64 WatchSource:0}: Error finding container 1744921a8ecf0b2218af856ac0854b6d34f52e4b69d592f093c05cd256d04f64: Status 404 returned error can't find the container with id 1744921a8ecf0b2218af856ac0854b6d34f52e4b69d592f093c05cd256d04f64 Jul 21 14:59:40.594703 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.594649 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4ae65e_7aa2_49de_a6cc_c08895ae1732.slice/crio-ee76b094b6c8df45d72ba3e9966b894870970f9be8d1310a29aebaee74e9f263 WatchSource:0}: Error finding container ee76b094b6c8df45d72ba3e9966b894870970f9be8d1310a29aebaee74e9f263: Status 404 returned error can't find the container with id ee76b094b6c8df45d72ba3e9966b894870970f9be8d1310a29aebaee74e9f263 Jul 21 14:59:40.599068 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.599031 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a674ac_0885_4138_baca_c274f4f7b94e.slice/crio-af83f90311f13f14e89bd40ffc24613c95c5ad12b8fee4e2d28afba343527f55 WatchSource:0}: Error finding container af83f90311f13f14e89bd40ffc24613c95c5ad12b8fee4e2d28afba343527f55: Status 404 returned error can't find the container with id af83f90311f13f14e89bd40ffc24613c95c5ad12b8fee4e2d28afba343527f55 Jul 21 14:59:40.600226 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.600185 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ed4b0b_5b21_46f3_af53_e2a25411b977.slice/crio-e802cd2774fd4baa100d07b7a161df5b9b7ffaceeeb8dac8103745970e2141e0 WatchSource:0}: Error finding container e802cd2774fd4baa100d07b7a161df5b9b7ffaceeeb8dac8103745970e2141e0: Status 404 returned error can't find the container with id e802cd2774fd4baa100d07b7a161df5b9b7ffaceeeb8dac8103745970e2141e0 Jul 21 14:59:40.600774 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.600758 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494cf10a_fb83_463f_bced_3c325c91952b.slice/crio-309ada690d50ba282980ca7eb2e75151a39adcfbd3a3b14c0200d4a2ccb2cd6b WatchSource:0}: Error finding container 309ada690d50ba282980ca7eb2e75151a39adcfbd3a3b14c0200d4a2ccb2cd6b: Status 404 returned error can't find the container with id 309ada690d50ba282980ca7eb2e75151a39adcfbd3a3b14c0200d4a2ccb2cd6b Jul 21 14:59:40.601701 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.601616 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeab3fe1_8dc2_4ff5_bbde_ffa46c89dfbd.slice/crio-486ff5fd900c8fe15d4f5856c794832bc168635bffc836cb41c828d465f4c057 WatchSource:0}: Error finding container 486ff5fd900c8fe15d4f5856c794832bc168635bffc836cb41c828d465f4c057: Status 404 returned error can't find the container with id 486ff5fd900c8fe15d4f5856c794832bc168635bffc836cb41c828d465f4c057 Jul 21 14:59:40.605740 ip-10-0-129-25 kubenswrapper[2585]: W0721 14:59:40.605703 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb06f20d_d5a9_41e7_a9e8_41b96d311c97.slice/crio-294780b5e7116961de19814094d0550781c43e643588d4b2e0d8e65166b827b3 WatchSource:0}: Error finding container 294780b5e7116961de19814094d0550781c43e643588d4b2e0d8e65166b827b3: Status 404 returned error can't find the container with id 294780b5e7116961de19814094d0550781c43e643588d4b2e0d8e65166b827b3 Jul 21 14:59:40.997678 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.997347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:40.997678 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:40.997644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:40.997872 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.997501 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:40.997872 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.997747 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:42.997723701 +0000 UTC m=+5.999978068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:40.997872 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.997766 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:40.997872 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:40.997818 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:42.997802626 +0000 UTC m=+6.000056994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:41.200488 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.200444 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:41.200654 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.200625 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:41.200654 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.200645 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:41.200770 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.200659 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:41.200770 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.200717 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:43.200698639 +0000 UTC m=+6.202953023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:41.416400 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.416304 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:54:39 +0000 UTC" deadline="2028-03-06 06:15:52.551488674 +0000 UTC" Jul 21 14:59:41.416400 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.416351 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14247h16m11.135143009s" Jul 21 14:59:41.554895 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.554865 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:41.555055 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.554987 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:41.555782 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.555757 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:41.555939 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:41.555915 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:41.582549 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.582508 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" event={"ID":"494cf10a-fb83-463f-bced-3c325c91952b","Type":"ContainerStarted","Data":"309ada690d50ba282980ca7eb2e75151a39adcfbd3a3b14c0200d4a2ccb2cd6b"} Jul 21 14:59:41.588666 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.588627 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerStarted","Data":"e802cd2774fd4baa100d07b7a161df5b9b7ffaceeeb8dac8103745970e2141e0"} Jul 21 14:59:41.591217 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.590933 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"af83f90311f13f14e89bd40ffc24613c95c5ad12b8fee4e2d28afba343527f55"} Jul 21 14:59:41.596324 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.596289 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h54f7" event={"ID":"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a","Type":"ContainerStarted","Data":"1744921a8ecf0b2218af856ac0854b6d34f52e4b69d592f093c05cd256d04f64"} Jul 21 14:59:41.609165 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.609123 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t6sc" event={"ID":"707069d9-bb46-4bd3-b971-7ad258eb89bc","Type":"ContainerStarted","Data":"c1b90ebcf59efcf516ae6a3f8149941598572acd9c80087e573fe9152e6e3e23"} Jul 21 14:59:41.629206 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.629172 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tkxr" event={"ID":"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd","Type":"ContainerStarted","Data":"486ff5fd900c8fe15d4f5856c794832bc168635bffc836cb41c828d465f4c057"} Jul 21 14:59:41.637281 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.637250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thl6k" event={"ID":"2b4ae65e-7aa2-49de-a6cc-c08895ae1732","Type":"ContainerStarted","Data":"ee76b094b6c8df45d72ba3e9966b894870970f9be8d1310a29aebaee74e9f263"} Jul 21 14:59:41.643894 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.643862 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-875xh" event={"ID":"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4","Type":"ContainerStarted","Data":"b8088cce9657055c55eb6aad6b600f5d8c8ae0649f5e13c76e979466b6213d40"} Jul 21 14:59:41.660008 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.659972 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"d26be7d37844b0dd9eb51bca7acab6c5","Type":"ContainerStarted","Data":"5afb821dbd4aa35212e4c102e36965014d2f74b2de3f767e48e5d8cb04bcc270"} Jul 21 14:59:41.668024 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.667903 2585 generic.go:356] "Generic (PLEG): container finished" podID="d173b50314f2a30cea0c002ada420dae" containerID="4c40bd0849ea7fff0c56e5eb8122ce968398a4288d1135f71baaa8df43778d60" exitCode=0 Jul 21 14:59:41.668024 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.667987 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"d173b50314f2a30cea0c002ada420dae","Type":"ContainerDied","Data":"4c40bd0849ea7fff0c56e5eb8122ce968398a4288d1135f71baaa8df43778d60"} Jul 21 14:59:41.677553 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.677412 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" podStartSLOduration=3.677393984 podStartE2EDuration="3.677393984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:41.67717632 +0000 UTC m=+4.679430708" watchObservedRunningTime="2026-07-21 14:59:41.677393984 +0000 UTC m=+4.679648375" Jul 21 14:59:41.680790 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:41.680521 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l6p2" event={"ID":"db06f20d-d5a9-41e7-a9e8-41b96d311c97","Type":"ContainerStarted","Data":"294780b5e7116961de19814094d0550781c43e643588d4b2e0d8e65166b827b3"} Jul 21 14:59:42.548962 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:42.548901 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:42.549442 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:42.549094 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:42.699839 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:42.699802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"d173b50314f2a30cea0c002ada420dae","Type":"ContainerStarted","Data":"6b969107cb1f3afbb7f62b08b8ac5a6642207c40d382721a0a1fdf91fc7cf2a7"} Jul 21 14:59:43.015620 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:43.015533 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:43.015620 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:43.015596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:43.015859 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.015749 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:43.015859 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.015811 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.015792983 +0000 UTC m=+10.018047361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:43.016375 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.016291 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:43.016375 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.016348 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.016331653 +0000 UTC m=+10.018586023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:43.217193 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:43.216938 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:43.217851 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.217140 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:43.217851 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.217416 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:43.217851 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.217443 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:43.217851 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.217510 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.217489614 +0000 UTC m=+10.219743981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:43.552279 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:43.552242 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:43.552279 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:43.552264 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:43.552801 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.552376 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:43.552801 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:43.552510 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:44.548858 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:44.548827 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:44.549053 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:44.548951 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:45.559296 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:45.559207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:45.559296 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:45.559244 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:45.559786 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:45.559360 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:45.559786 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:45.559505 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:46.548327 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:46.548295 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:46.548495 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:46.548406 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:47.049103 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:47.049066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:47.049569 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:47.049118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:47.049569 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.049230 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:47.049569 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.049250 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:47.049569 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.049307 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:55.04928789 +0000 UTC m=+18.051542286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:47.049569 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.049327 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:55.049316334 +0000 UTC m=+18.051570702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:47.250681 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:47.250644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:47.250853 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.250797 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:47.250853 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.250819 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:47.250853 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.250832 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:47.251027 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.250888 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:55.250871405 +0000 UTC m=+18.253125775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:47.549861 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:47.549826 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:47.550037 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.549948 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:47.550037 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:47.549989 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:47.550180 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:47.550065 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:48.549212 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:48.548731 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:48.549212 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:48.548868 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:49.549287 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:49.549250 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:49.549733 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:49.549397 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:49.549796 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:49.549734 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:49.549836 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:49.549801 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:50.548397 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:50.548306 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:50.548557 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:50.548435 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:51.551594 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:51.551564 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:51.552000 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:51.551681 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:51.552000 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:51.551742 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:51.552000 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:51.551817 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:52.548672 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:52.548632 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:52.548831 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:52.548744 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:53.548424 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:53.548379 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:53.548785 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:53.548509 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:53.548828 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:53.548792 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:53.548858 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:53.548847 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:54.548501 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:54.548459 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:54.548974 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:54.548587 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:55.112610 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:55.112575 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:55.112797 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:55.112619 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:55.112797 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.112724 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:55.112797 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.112730 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:55.112797 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.112779 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:11.112764118 +0000 UTC m=+34.115018482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:59:55.112797 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.112798 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 15:00:11.112788905 +0000 UTC m=+34.115043272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:59:55.314492 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:55.314461 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:55.314674 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.314653 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:59:55.314732 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.314679 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:59:55.314732 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.314691 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:55.314827 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.314755 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:11.314736847 +0000 UTC m=+34.316991214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:59:55.548924 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:55.548834 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:55.549370 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:55.548835 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:55.549370 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.548990 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:55.549370 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:55.549057 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:56.548683 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:56.548651 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:56.548864 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:56.548768 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:57.550370 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:57.549631 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:57.550370 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:57.549744 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:57.550370 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:57.549806 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:57.550370 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:57.549899 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:58.548889 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:58.548855 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 14:59:58.549088 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:58.548992 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 14:59:59.548874 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.548750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 14:59:59.548874 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:59.548857 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 14:59:59.549357 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.548750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 14:59:59.549357 ip-10-0-129-25 kubenswrapper[2585]: E0721 14:59:59.549191 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 14:59:59.735206 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.734976 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" event={"ID":"494cf10a-fb83-463f-bced-3c325c91952b","Type":"ContainerStarted","Data":"dd0fb12bce5d8a9838ace2a8ff37df2b2a6bbf28393d4089f0f1b39b89a0a6ef"} Jul 21 14:59:59.736883 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.736855 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="b2bb4108d258625f3274bd3c08461f1397a74f646082e5ab2b8c4b2125609615" exitCode=0 Jul 21 14:59:59.736993 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.736939 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"b2bb4108d258625f3274bd3c08461f1397a74f646082e5ab2b8c4b2125609615"} Jul 21 14:59:59.739472 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.739173 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"f86c39a0f78aafa62283006e39d20741eb92ca8c7282cb0d9019f23d18482d36"} Jul 21 14:59:59.741384 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.741356 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h54f7" event={"ID":"c68ffdc1-d2af-4ab9-bd1b-50458cb0287a","Type":"ContainerStarted","Data":"2938fd0f6473fe3fa542050ac2b8430697799caeb147c9fc9b97c66ff4bfb54e"} Jul 21 14:59:59.742952 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.742926 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t6sc" event={"ID":"707069d9-bb46-4bd3-b971-7ad258eb89bc","Type":"ContainerStarted","Data":"7ebd8b4b276df5fe80ab76c23dcc635f9f9c62dec38607c7f220a53a201d644a"} Jul 21 14:59:59.744530 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.744469 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tkxr" event={"ID":"deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd","Type":"ContainerStarted","Data":"179f58774dfbbaf9d15f57823c1eb8a9b03012372c89c22e9e615260f2cde9c2"} Jul 21 14:59:59.746009 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.745988 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thl6k" event={"ID":"2b4ae65e-7aa2-49de-a6cc-c08895ae1732","Type":"ContainerStarted","Data":"380e6678b7f7086b5060366b11c3b8b7a35dd730b5be82f6969a71dcc7851d1b"} Jul 21 14:59:59.747285 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.747267 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-875xh" event={"ID":"29ffa9eb-a8ab-4500-a6d7-2b2958b12da4","Type":"ContainerStarted","Data":"4b7dfc01ce9c382650e5dfb69beb2a73d84d297e84cf61c7abbdf3af75138251"} Jul 21 14:59:59.761795 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.761745 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" podStartSLOduration=21.761731177 podStartE2EDuration="21.761731177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:42.719018486 +0000 UTC m=+5.721272874" watchObservedRunningTime="2026-07-21 14:59:59.761731177 +0000 UTC m=+22.763985564" Jul 21 14:59:59.795215 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.795135 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5t6sc" podStartSLOduration=8.721369626 podStartE2EDuration="22.79512181s" totalImagesPullingTime="14.073752184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:59.777135095 +0000 UTC m=+22.779389480" watchObservedRunningTime="2026-07-21 14:59:59.79512181 +0000 UTC m=+22.797376200" Jul 21 14:59:59.795648 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.795618 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-thl6k" podStartSLOduration=4.130524203 podStartE2EDuration="22.79560896s" totalImagesPullingTime="18.665084757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:59.794836947 +0000 UTC m=+22.797091327" watchObservedRunningTime="2026-07-21 14:59:59.79560896 +0000 UTC m=+22.797863347" Jul 21 14:59:59.813196 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.813115 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4tkxr" podStartSLOduration=4.114947893 podStartE2EDuration="22.813094816s" totalImagesPullingTime="18.698146923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:59.812803109 +0000 UTC m=+22.815057495" watchObservedRunningTime="2026-07-21 14:59:59.813094816 +0000 UTC m=+22.815349204" Jul 21 14:59:59.833816 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.833774 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-875xh" podStartSLOduration=4.188018562 podStartE2EDuration="22.833760568s" totalImagesPullingTime="18.645742006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:59.833356855 +0000 UTC m=+22.835611243" watchObservedRunningTime="2026-07-21 14:59:59.833760568 +0000 UTC m=+22.836014954" Jul 21 14:59:59.847329 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.847279 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h54f7" podStartSLOduration=4.183900375 podStartE2EDuration="22.847261038s" totalImagesPullingTime="18.663360663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:59.847007965 +0000 UTC m=+22.849262355" watchObservedRunningTime="2026-07-21 14:59:59.847261038 +0000 UTC m=+22.849515426" Jul 21 14:59:59.963503 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.963137 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 14:59:59.963578 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.963534 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 14:59:59.964059 ip-10-0-129-25 kubenswrapper[2585]: I0721 14:59:59.964042 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 15:00:00.040133 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.040108 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:00.548874 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.548834 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:00.549546 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:00.548945 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:00.750558 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.750519 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l6p2" event={"ID":"db06f20d-d5a9-41e7-a9e8-41b96d311c97","Type":"ContainerStarted","Data":"49ffcdc05322d2d7efd63e53d970c22c0881bda1204a7bca394d74f42b959748"} Jul 21 15:00:00.753001 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.752984 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:00:00.753300 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753281 2585 generic.go:356] "Generic (PLEG): container finished" podID="f5a674ac-0885-4138-baca-c274f4f7b94e" containerID="1b7639c01f5ba760cd420e221512daa5d5d2fe6c9ed399785890a2139b0db5a0" exitCode=1 Jul 21 15:00:00.753392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753372 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerDied","Data":"1b7639c01f5ba760cd420e221512daa5d5d2fe6c9ed399785890a2139b0db5a0"} Jul 21 15:00:00.753487 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753433 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"48915b75768753b83d2c7712e7ea038fa2d928fbb06ff01935e7646a091e9209"} Jul 21 15:00:00.753487 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753465 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"139d72faaa61f7f1d81b82595046014622c418b22cee6c348c5ab043164d937f"} Jul 21 15:00:00.753667 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753649 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 15:00:00.753755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753688 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"55939e76db0be7a5a694e2a85233393a1013c3c96d125434c9b6edb7e2684b5d"} Jul 21 15:00:00.753755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.753744 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"86fd117bf7b96b160135f9eff6c099c9db6f689474d21e2a5c989f7719407afc"} Jul 21 15:00:00.754065 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.754049 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5t6sc" Jul 21 15:00:00.767315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.767275 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6l6p2" podStartSLOduration=5.114378439 podStartE2EDuration="23.767261668s" totalImagesPullingTime="18.652883229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:00.767032782 +0000 UTC m=+23.769287170" watchObservedRunningTime="2026-07-21 15:00:00.767261668 +0000 UTC m=+23.769516055" Jul 21 15:00:00.889648 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.889618 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:00.967646 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:00.967624 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 15:00:01.003499 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.003473 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:01.454024 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.453880 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T15:00:00.967640826Z","UUID":"93f18bef-76e0-4e19-9698-c62d711db978","Handler":null,"Name":"","Endpoint":""} Jul 21 15:00:01.455599 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.455575 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 15:00:01.455710 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.455626 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 15:00:01.548965 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.548934 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:01.549539 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:01.549063 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:01.549539 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.549440 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:01.549539 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:01.549517 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:01.758175 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:01.758069 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" event={"ID":"494cf10a-fb83-463f-bced-3c325c91952b","Type":"ContainerStarted","Data":"49b518ebbf2985264e6e5640a25405f42633fe4524638b597f40dbb6b374521d"} Jul 21 15:00:02.548881 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:02.548807 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:02.549008 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:02.548909 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:02.761775 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:02.761737 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" event={"ID":"494cf10a-fb83-463f-bced-3c325c91952b","Type":"ContainerStarted","Data":"52048ffe7f98512a7170647a8859dc4008a979c42b2179dda136edc86ef73042"} Jul 21 15:00:02.764659 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:02.764640 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:00:02.764968 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:02.764948 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"d647506b23260d65f11dbc31d91af8b4ccaedf147115338bb115cf9129036f7f"} Jul 21 15:00:02.781115 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:02.781072 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4jq9" podStartSLOduration=4.667246343 podStartE2EDuration="25.781059854s" totalImagesPullingTime="21.113813511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:02.780818946 +0000 UTC m=+25.783073332" watchObservedRunningTime="2026-07-21 15:00:02.781059854 +0000 UTC m=+25.783314241" Jul 21 15:00:03.548588 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:03.548555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:03.548747 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:03.548703 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:03.548800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:03.548763 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:03.548896 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:03.548865 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:04.548779 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:04.548530 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:04.549257 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:04.548900 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:04.566421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:04.566351 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:05.549086 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.549058 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:05.549725 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:05.549219 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:05.549725 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.549271 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:05.549725 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:05.549388 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:05.772778 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.772744 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="88c21d3c8987b07abb422ba24cd402c106323f085ec9e7c8ae60a9193ecf2c05" exitCode=0 Jul 21 15:00:05.772911 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.772818 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"88c21d3c8987b07abb422ba24cd402c106323f085ec9e7c8ae60a9193ecf2c05"} Jul 21 15:00:05.776079 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.776064 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:00:05.776401 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.776381 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"c8f7e17494d0304d94ed2bc56355aa65f9aca30aa3bab2b8c444d95e81848ac3"} Jul 21 15:00:05.776707 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.776676 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:05.776801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.776765 2585 scope.go:117] "RemoveContainer" containerID="1b7639c01f5ba760cd420e221512daa5d5d2fe6c9ed399785890a2139b0db5a0" Jul 21 15:00:05.776801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.776774 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:05.792492 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.792459 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:05.794412 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:05.794391 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:06.549098 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:06.549062 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:06.549524 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:06.549218 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:06.785793 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:06.785639 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:00:06.786281 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:06.786250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" event={"ID":"f5a674ac-0885-4138-baca-c274f4f7b94e","Type":"ContainerStarted","Data":"12fdc75dbaa375c503c5b5379f470844c7af535e04ba7cb233028afe117b6e37"} Jul 21 15:00:06.786443 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:06.786425 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:06.815425 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:06.815334 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" podStartSLOduration=10.88105792 podStartE2EDuration="29.81531939s" totalImagesPullingTime="18.93426147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:06.814803879 +0000 UTC m=+29.817058268" watchObservedRunningTime="2026-07-21 15:00:06.81531939 +0000 UTC m=+29.817573777" Jul 21 15:00:07.249056 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.249018 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2x2bm"] Jul 21 15:00:07.249245 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.249162 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:07.249328 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:07.249271 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:07.251699 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.251681 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kvkmn"] Jul 21 15:00:07.251779 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.251769 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:07.251857 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:07.251842 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:07.261541 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.261516 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdph4"] Jul 21 15:00:07.261664 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.261622 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:07.261735 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:07.261717 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:07.610932 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.610900 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:07.792357 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.792328 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="8703b4aca683ef9b08e148599d16df7cddabe79c30358b5dd3502f5feafc2ad5" exitCode=0 Jul 21 15:00:07.792481 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:07.792412 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"8703b4aca683ef9b08e148599d16df7cddabe79c30358b5dd3502f5feafc2ad5"} Jul 21 15:00:08.549009 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:08.548974 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:08.549009 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:08.548997 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:08.549206 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:08.549125 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:08.549206 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:08.549175 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:08.549321 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:08.549301 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:08.549419 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:08.549395 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:08.797839 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:08.797811 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="81e5487f04cc69ae1311bae9c657650adc355592bd8d5a03a01cc0520629e103" exitCode=0 Jul 21 15:00:08.798194 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:08.797867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"81e5487f04cc69ae1311bae9c657650adc355592bd8d5a03a01cc0520629e103"} Jul 21 15:00:10.548421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:10.548228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:10.548909 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:10.548228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:10.548909 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:10.548524 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:00:10.548909 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:10.548228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:10.548909 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:10.548566 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2x2bm" podUID="92ad084b-b180-4f42-b401-785ee1b6b965" Jul 21 15:00:10.548909 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:10.548664 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdph4" podUID="59a804e7-5daa-4f55-9b60-1e5e38aeac25" Jul 21 15:00:11.133670 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.133634 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:11.133848 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.133686 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:11.133848 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.133780 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:00:11.133848 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.133780 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:00:11.133848 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.133841 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret podName:92ad084b-b180-4f42-b401-785ee1b6b965 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:43.133819873 +0000 UTC m=+66.136074237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret") pod "global-pull-secret-syncer-2x2bm" (UID: "92ad084b-b180-4f42-b401-785ee1b6b965") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:00:11.134012 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.133861 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 15:00:43.133849889 +0000 UTC m=+66.136104254 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:00:11.335542 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.335507 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:11.335718 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.335661 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:00:11.335718 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.335682 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:00:11.335718 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.335694 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mv5w6 for pod openshift-network-diagnostics/network-check-target-kdph4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:00:11.335844 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:11.335750 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6 podName:59a804e7-5daa-4f55-9b60-1e5e38aeac25 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:43.335733478 +0000 UTC m=+66.337987846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv5w6" (UniqueName: "kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6") pod "network-check-target-kdph4" (UID: "59a804e7-5daa-4f55-9b60-1e5e38aeac25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:00:11.630219 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.630173 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:11.689381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.689340 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:11.934069 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.934027 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:11.995521 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:11.995486 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:12.370602 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.370566 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeReady" Jul 21 15:00:12.370762 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.370691 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 15:00:12.416841 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.416810 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sclfg"] Jul 21 15:00:12.450900 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.450868 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfx8"] Jul 21 15:00:12.451083 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.450987 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.453340 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.453308 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 15:00:12.453340 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.453326 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhwsr\"" Jul 21 15:00:12.453662 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.453643 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 15:00:12.466222 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.466200 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sclfg"] Jul 21 15:00:12.466222 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.466239 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfx8"] Jul 21 15:00:12.466376 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.466274 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.468846 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.468824 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 15:00:12.468929 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.468900 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 15:00:12.469032 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.469019 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-frd55\"" Jul 21 15:00:12.469227 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.469211 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 15:00:12.544094 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.544054 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/910bcdf3-7232-4eba-b6da-07c0d3925ef9-config-volume\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.544094 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.544100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/910bcdf3-7232-4eba-b6da-07c0d3925ef9-tmp-dir\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.544348 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.544187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvxvr\" (UniqueName: \"kubernetes.io/projected/910bcdf3-7232-4eba-b6da-07c0d3925ef9-kube-api-access-wvxvr\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.544348 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.544232 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.549118 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.549092 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:12.549264 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.549121 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:12.549264 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.549135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:12.551605 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.551580 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 15:00:12.551718 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.551691 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2gv2\"" Jul 21 15:00:12.551782 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.551721 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 15:00:12.551866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.551848 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 15:00:12.551927 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.551891 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 15:00:12.552036 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.552013 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nplsp\"" Jul 21 15:00:12.569810 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.569785 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:12.645420 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645324 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/910bcdf3-7232-4eba-b6da-07c0d3925ef9-config-volume\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.645420 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645363 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/910bcdf3-7232-4eba-b6da-07c0d3925ef9-tmp-dir\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.645844 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645436 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvxvr\" (UniqueName: \"kubernetes.io/projected/910bcdf3-7232-4eba-b6da-07c0d3925ef9-kube-api-access-wvxvr\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.645844 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.645844 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645501 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpfj\" (UniqueName: \"kubernetes.io/projected/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-kube-api-access-rjpfj\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.645844 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645732 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/910bcdf3-7232-4eba-b6da-07c0d3925ef9-tmp-dir\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.645844 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:12.645820 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:12.646034 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:12.645869 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:13.145855239 +0000 UTC m=+36.148109605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:12.646034 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.645943 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-cert\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.646140 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.646058 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/910bcdf3-7232-4eba-b6da-07c0d3925ef9-config-volume\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.659564 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.659537 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvxvr\" (UniqueName: \"kubernetes.io/projected/910bcdf3-7232-4eba-b6da-07c0d3925ef9-kube-api-access-wvxvr\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:12.668820 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.668793 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:12.746753 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.746722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-cert\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.746915 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.746819 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpfj\" (UniqueName: \"kubernetes.io/projected/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-kube-api-access-rjpfj\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.749538 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.749516 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-cert\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.759429 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.759404 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpfj\" (UniqueName: \"kubernetes.io/projected/f980dc71-0dbc-49a1-8543-bde8f8fb8fb5-kube-api-access-rjpfj\") pod \"ingress-canary-4xfx8\" (UID: \"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5\") " pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:12.776344 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:12.776319 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xfx8" Jul 21 15:00:13.149771 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:13.149743 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:13.149927 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:13.149908 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:13.149989 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:13.149979 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:14.149959218 +0000 UTC m=+37.152213584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:13.283121 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:13.283088 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfx8"] Jul 21 15:00:13.353584 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:00:13.353545 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf980dc71_0dbc_49a1_8543_bde8f8fb8fb5.slice/crio-fbf5bd8e0574e95cb78b572f377c47455cd90a875b00a67cdbececc97bd46605 WatchSource:0}: Error finding container fbf5bd8e0574e95cb78b572f377c47455cd90a875b00a67cdbececc97bd46605: Status 404 returned error can't find the container with id fbf5bd8e0574e95cb78b572f377c47455cd90a875b00a67cdbececc97bd46605 Jul 21 15:00:13.815071 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:13.814815 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="4eb05680147c81dcae8dcdbe1c3b51475693d22de4695eb230100e3496787453" exitCode=0 Jul 21 15:00:13.815071 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:13.814891 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"4eb05680147c81dcae8dcdbe1c3b51475693d22de4695eb230100e3496787453"} Jul 21 15:00:13.816188 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:13.816165 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xfx8" event={"ID":"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5","Type":"ContainerStarted","Data":"fbf5bd8e0574e95cb78b572f377c47455cd90a875b00a67cdbececc97bd46605"} Jul 21 15:00:14.155438 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:14.155401 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:14.155592 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:14.155541 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:14.155628 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:14.155597 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:16.155580956 +0000 UTC m=+39.157835321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:14.820954 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:14.820916 2585 generic.go:356] "Generic (PLEG): container finished" podID="03ed4b0b-5b21-46f3-af53-e2a25411b977" containerID="6c3ebde08569a463f33e4e051689883b4be19e519f0e2b1008181aba1135857c" exitCode=0 Jul 21 15:00:14.821355 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:14.820982 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerDied","Data":"6c3ebde08569a463f33e4e051689883b4be19e519f0e2b1008181aba1135857c"} Jul 21 15:00:15.828301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:15.828268 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" event={"ID":"03ed4b0b-5b21-46f3-af53-e2a25411b977","Type":"ContainerStarted","Data":"b1ed9d6a2436664403b5e73f60ee01febcf8e4090f008e735756db31b19d108e"} Jul 21 15:00:15.858213 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:15.858127 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tm8wg" podStartSLOduration=7.118414693 podStartE2EDuration="38.85810958s" totalImagesPullingTime="31.739694887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:15.856372728 +0000 UTC m=+38.858627119" watchObservedRunningTime="2026-07-21 15:00:15.85810958 +0000 UTC m=+38.860363967" Jul 21 15:00:15.983495 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:15.983463 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:16.171742 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:16.171710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:16.171929 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:16.171863 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:16.171995 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:16.171939 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:20.171918568 +0000 UTC m=+43.174172932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:16.600961 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:16.600927 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:17.774448 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:17.774420 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:17.873898 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:17.873872 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:18.836740 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.836704 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xfx8" event={"ID":"f980dc71-0dbc-49a1-8543-bde8f8fb8fb5","Type":"ContainerStarted","Data":"080c91a97857f3d6c8a30c652832931258cde816ca46d9f227446550a90bbc42"} Jul 21 15:00:18.853009 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.852963 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4xfx8" podStartSLOduration=2.395755389 podStartE2EDuration="6.85294762s" totalImagesPullingTime="4.457192231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:18.852918846 +0000 UTC m=+41.855173233" watchObservedRunningTime="2026-07-21 15:00:18.85294762 +0000 UTC m=+41.855201989" Jul 21 15:00:18.959523 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.959435 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b566c7dc-lmmsl"] Jul 21 15:00:18.978948 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.978922 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b566c7dc-lmmsl"] Jul 21 15:00:18.979126 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.979030 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:18.982074 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.982047 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 15:00:18.982250 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.982213 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 15:00:18.982250 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.982239 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q548f\"" Jul 21 15:00:18.982611 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.982595 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 15:00:18.988324 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:18.988305 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 15:00:19.093262 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093262 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093341 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv55l\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093374 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093432 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093455 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.093484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.093480 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194750 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194767 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv55l\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.194837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194785 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.195055 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194843 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.195055 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.194889 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.195055 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.195009 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:19.195055 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.195026 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:19.195268 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.195125 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:19.695101154 +0000 UTC m=+42.697355538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:19.195489 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.195459 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.195582 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.195565 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.195663 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.195644 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.198536 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.198514 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.198619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.198548 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.204504 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.204478 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv55l\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.205298 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.205280 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.698940 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:19.698904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:19.699109 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.699051 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:19.699109 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.699072 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:19.699200 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:19.699129 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:20.699112469 +0000 UTC m=+43.701366839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:20.202475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:20.202441 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:20.202852 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:20.202566 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:20.202852 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:20.202616 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:28.202602861 +0000 UTC m=+51.204857226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:20.706895 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:20.706852 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:20.707049 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:20.707013 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:20.707049 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:20.707034 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:20.707180 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:20.707088 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:22.707073387 +0000 UTC m=+45.709327752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:22.721216 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:22.721170 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:22.721687 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:22.721337 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:22.721687 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:22.721358 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:22.721687 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:22.721432 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:26.721412679 +0000 UTC m=+49.723667064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:26.750772 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:26.750740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:26.751268 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:26.750874 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:26.751268 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:26.750886 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:26.751268 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:26.750936 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:34.750922858 +0000 UTC m=+57.753177222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:28.262027 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:28.261988 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:28.262463 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:28.262142 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:28.262463 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:28.262245 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:44.262226965 +0000 UTC m=+67.264481332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:29.899567 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:29.899518 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:30.001076 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:30.001044 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:34.808895 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:34.808847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:34.809326 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:34.808998 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:34.809326 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:34.809017 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:34.809326 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:34.809073 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:50.809058014 +0000 UTC m=+73.811312381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:00:37.803742 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:37.803712 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wzkb" Jul 21 15:00:37.945963 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:37.945935 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:38.041829 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:38.041801 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:00:43.173696 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.173653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:00:43.174089 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.173703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:43.176389 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.176370 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 15:00:43.176469 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.176453 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 15:00:43.184513 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:43.184494 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 15:00:43.184593 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:43.184570 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:47.184549104 +0000 UTC m=+130.186803470 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : secret "metrics-daemon-secret" not found Jul 21 15:00:43.186743 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.186726 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92ad084b-b180-4f42-b401-785ee1b6b965-original-pull-secret\") pod \"global-pull-secret-syncer-2x2bm\" (UID: \"92ad084b-b180-4f42-b401-785ee1b6b965\") " pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:43.374967 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.374927 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:43.377733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.377710 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 15:00:43.388588 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.388570 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 15:00:43.399493 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.399467 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv5w6\" (UniqueName: \"kubernetes.io/projected/59a804e7-5daa-4f55-9b60-1e5e38aeac25-kube-api-access-mv5w6\") pod \"network-check-target-kdph4\" (UID: \"59a804e7-5daa-4f55-9b60-1e5e38aeac25\") " pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:43.471378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.471292 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nplsp\"" Jul 21 15:00:43.475413 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.475391 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2x2bm" Jul 21 15:00:43.479536 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.479518 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:43.635908 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.635877 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2x2bm"] Jul 21 15:00:43.639052 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:00:43.639028 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ad084b_b180_4f42_b401_785ee1b6b965.slice/crio-d52f2de7e049a6af145251511623443dd258497c311bbc34aa93345e1a0f1c88 WatchSource:0}: Error finding container d52f2de7e049a6af145251511623443dd258497c311bbc34aa93345e1a0f1c88: Status 404 returned error can't find the container with id d52f2de7e049a6af145251511623443dd258497c311bbc34aa93345e1a0f1c88 Jul 21 15:00:43.663252 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.663226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdph4"] Jul 21 15:00:43.666407 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:00:43.666383 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a804e7_5daa_4f55_9b60_1e5e38aeac25.slice/crio-601fd9009d5ee9b22a074ea9b2a3d2f84e7f8cb33f0e49eaead5d164d0ae7742 WatchSource:0}: Error finding container 601fd9009d5ee9b22a074ea9b2a3d2f84e7f8cb33f0e49eaead5d164d0ae7742: Status 404 returned error can't find the container with id 601fd9009d5ee9b22a074ea9b2a3d2f84e7f8cb33f0e49eaead5d164d0ae7742 Jul 21 15:00:43.893738 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.893701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2x2bm" event={"ID":"92ad084b-b180-4f42-b401-785ee1b6b965","Type":"ContainerStarted","Data":"d52f2de7e049a6af145251511623443dd258497c311bbc34aa93345e1a0f1c88"} Jul 21 15:00:43.894663 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:43.894644 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdph4" event={"ID":"59a804e7-5daa-4f55-9b60-1e5e38aeac25","Type":"ContainerStarted","Data":"601fd9009d5ee9b22a074ea9b2a3d2f84e7f8cb33f0e49eaead5d164d0ae7742"} Jul 21 15:00:44.282730 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:44.282553 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:00:44.283107 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:44.282726 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:00:44.283107 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:44.282804 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:16.28278309 +0000 UTC m=+99.285037458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:00:48.909980 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:48.909935 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdph4" event={"ID":"59a804e7-5daa-4f55-9b60-1e5e38aeac25","Type":"ContainerStarted","Data":"48153ef22c516ad04b6bb52caf050e371e3ec31e2372d869911fd27674752510"} Jul 21 15:00:48.910464 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:48.910062 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:00:48.911440 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:48.911419 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2x2bm" event={"ID":"92ad084b-b180-4f42-b401-785ee1b6b965","Type":"ContainerStarted","Data":"15e36a5c98813fb84351296519f448437312be19ffacb10a76b62fe1a3d1c220"} Jul 21 15:00:48.928520 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:48.928480 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kdph4" podStartSLOduration=67.549196133 podStartE2EDuration="1m11.928465318s" totalImagesPullingTime="4.379269185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:48.927171893 +0000 UTC m=+71.929426275" watchObservedRunningTime="2026-07-21 15:00:48.928465318 +0000 UTC m=+71.930719705" Jul 21 15:00:48.944781 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:48.944741 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2x2bm" podStartSLOduration=67.533949795 podStartE2EDuration="1m11.944725408s" totalImagesPullingTime="4.410775613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:48.944382384 +0000 UTC m=+71.946636771" watchObservedRunningTime="2026-07-21 15:00:48.944725408 +0000 UTC m=+71.946979786" Jul 21 15:00:50.829671 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:00:50.829635 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:00:50.830044 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:50.829762 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:00:50.830044 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:50.829774 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:00:50.830044 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:00:50.829823 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:22.829808991 +0000 UTC m=+105.832063356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:01:16.321166 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:01:16.321022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:01:16.321547 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:16.321194 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:01:16.321547 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:16.321281 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:20.321262921 +0000 UTC m=+163.323517286 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:01:19.915961 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:01:19.915931 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kdph4" Jul 21 15:01:22.870215 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:01:22.870169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:01:22.870624 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:22.870306 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:01:22.870624 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:22.870319 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:01:22.870624 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:22.870384 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:26.870366238 +0000 UTC m=+169.872620605 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:01:47.251497 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:01:47.251436 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:01:47.252065 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:47.251583 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 15:01:47.252065 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:01:47.251659 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs podName:8529b685-aecf-4eeb-a3cd-538037c7732e nodeName:}" failed. No retries permitted until 2026-07-21 15:03:49.251637116 +0000 UTC m=+252.253891485 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs") pod "network-metrics-daemon-kvkmn" (UID: "8529b685-aecf-4eeb-a3cd-538037c7732e") : secret "metrics-daemon-secret" not found Jul 21 15:02:15.461390 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:15.461324 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sclfg" podUID="910bcdf3-7232-4eba-b6da-07c0d3925ef9" Jul 21 15:02:15.560956 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:15.560917 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kvkmn" podUID="8529b685-aecf-4eeb-a3cd-538037c7732e" Jul 21 15:02:16.121528 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:02:16.121493 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sclfg" Jul 21 15:02:20.389735 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:02:20.389692 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:02:20.390185 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:20.389805 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:02:20.390185 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:20.389866 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls podName:910bcdf3-7232-4eba-b6da-07c0d3925ef9 nodeName:}" failed. No retries permitted until 2026-07-21 15:04:22.389850773 +0000 UTC m=+285.392105137 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls") pod "dns-default-sclfg" (UID: "910bcdf3-7232-4eba-b6da-07c0d3925ef9") : secret "dns-default-metrics-tls" not found Jul 21 15:02:21.988361 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:21.988321 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" podUID="e8bf8563-1030-486c-bb2c-37b14f1b8926" Jul 21 15:02:26.932929 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:02:26.932879 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") pod \"image-registry-86b566c7dc-lmmsl\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:02:26.933349 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:26.933031 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 15:02:26.933349 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:26.933050 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b566c7dc-lmmsl: secret "image-registry-tls" not found Jul 21 15:02:26.933349 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:02:26.933108 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls podName:e8bf8563-1030-486c-bb2c-37b14f1b8926 nodeName:}" failed. No retries permitted until 2026-07-21 15:04:28.93309283 +0000 UTC m=+291.935347196 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls") pod "image-registry-86b566c7dc-lmmsl" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926") : secret "image-registry-tls" not found Jul 21 15:02:30.548543 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:02:30.548446 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:02:32.548560 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:02:32.548524 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:03:06.285680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:06.285624 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:30.428252 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.428220 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t"] Jul 21 15:03:30.430095 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.430080 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.432096 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.432068 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws"] Jul 21 15:03:30.432431 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.432406 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 15:03:30.432594 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.432572 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 15:03:30.433353 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.433322 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 15:03:30.433615 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.433591 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7srd5\"" Jul 21 15:03:30.436214 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.433948 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.436214 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.434241 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:03:30.439110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.438992 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:03:30.439389 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.439371 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 15:03:30.439488 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.439412 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 15:03:30.439488 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.439457 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q476b\"" Jul 21 15:03:30.451739 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.451714 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t"] Jul 21 15:03:30.452659 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.452636 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws"] Jul 21 15:03:30.575267 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.575235 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfph8\" (UniqueName: \"kubernetes.io/projected/6cf9eb49-dfa2-412a-a656-8a5f758d340b-kube-api-access-bfph8\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.575267 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.575269 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czkx\" (UniqueName: \"kubernetes.io/projected/0299aaba-8e54-492c-b49e-9defcaa70a49-kube-api-access-6czkx\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.575513 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.575289 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0299aaba-8e54-492c-b49e-9defcaa70a49-config\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.575513 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.575404 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0299aaba-8e54-492c-b49e-9defcaa70a49-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.575513 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.575439 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.628399 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.628367 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:30.676514 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.676484 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfph8\" (UniqueName: \"kubernetes.io/projected/6cf9eb49-dfa2-412a-a656-8a5f758d340b-kube-api-access-bfph8\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.676621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.676523 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czkx\" (UniqueName: \"kubernetes.io/projected/0299aaba-8e54-492c-b49e-9defcaa70a49-kube-api-access-6czkx\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.676621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.676542 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0299aaba-8e54-492c-b49e-9defcaa70a49-config\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.676621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.676581 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0299aaba-8e54-492c-b49e-9defcaa70a49-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.676621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.676598 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.676802 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:30.676669 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 15:03:30.676802 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:30.676737 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls podName:6cf9eb49-dfa2-412a-a656-8a5f758d340b nodeName:}" failed. No retries permitted until 2026-07-21 15:03:31.176720098 +0000 UTC m=+234.178974464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-df5ws" (UID: "6cf9eb49-dfa2-412a-a656-8a5f758d340b") : secret "samples-operator-tls" not found Jul 21 15:03:30.677138 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.677118 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0299aaba-8e54-492c-b49e-9defcaa70a49-config\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.679027 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.678977 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0299aaba-8e54-492c-b49e-9defcaa70a49-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.685913 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.685893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfph8\" (UniqueName: \"kubernetes.io/projected/6cf9eb49-dfa2-412a-a656-8a5f758d340b-kube-api-access-bfph8\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:30.685994 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.685925 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czkx\" (UniqueName: \"kubernetes.io/projected/0299aaba-8e54-492c-b49e-9defcaa70a49-kube-api-access-6czkx\") pod \"service-ca-operator-5bcbc94c78-sqn9t\" (UID: \"0299aaba-8e54-492c-b49e-9defcaa70a49\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.729004 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.728973 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:30.741936 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.741912 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" Jul 21 15:03:30.860822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:30.860789 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t"] Jul 21 15:03:30.863832 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:03:30.863802 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0299aaba_8e54_492c_b49e_9defcaa70a49.slice/crio-2c9a482cfa05ae6621de0a1bdb2b53b2afbc9a9fe286704dcee5c0bf14acac1f WatchSource:0}: Error finding container 2c9a482cfa05ae6621de0a1bdb2b53b2afbc9a9fe286704dcee5c0bf14acac1f: Status 404 returned error can't find the container with id 2c9a482cfa05ae6621de0a1bdb2b53b2afbc9a9fe286704dcee5c0bf14acac1f Jul 21 15:03:31.181076 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:31.181047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:31.181264 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:31.181191 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 15:03:31.181264 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:31.181245 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls podName:6cf9eb49-dfa2-412a-a656-8a5f758d340b nodeName:}" failed. No retries permitted until 2026-07-21 15:03:32.181230342 +0000 UTC m=+235.183484706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-df5ws" (UID: "6cf9eb49-dfa2-412a-a656-8a5f758d340b") : secret "samples-operator-tls" not found Jul 21 15:03:31.297984 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:31.297950 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" event={"ID":"0299aaba-8e54-492c-b49e-9defcaa70a49","Type":"ContainerStarted","Data":"2c9a482cfa05ae6621de0a1bdb2b53b2afbc9a9fe286704dcee5c0bf14acac1f"} Jul 21 15:03:32.190057 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:32.190019 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:32.190539 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:32.190216 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 15:03:32.190539 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:32.190284 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls podName:6cf9eb49-dfa2-412a-a656-8a5f758d340b nodeName:}" failed. No retries permitted until 2026-07-21 15:03:34.190267689 +0000 UTC m=+237.192522054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-df5ws" (UID: "6cf9eb49-dfa2-412a-a656-8a5f758d340b") : secret "samples-operator-tls" not found Jul 21 15:03:32.366375 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:32.366329 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:32.427487 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:32.427450 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:33.305271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:33.305240 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" event={"ID":"0299aaba-8e54-492c-b49e-9defcaa70a49","Type":"ContainerStarted","Data":"cf78269923b06e5c1ae5d0092dcbff0ba7f50b26ae760cea1a937553b7949650"} Jul 21 15:03:33.322876 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:33.322827 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" podStartSLOduration=1.447558062 podStartE2EDuration="3.322808547s" totalImagesPullingTime="1.875250485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:33.322122106 +0000 UTC m=+236.324376492" watchObservedRunningTime="2026-07-21 15:03:33.322808547 +0000 UTC m=+236.325062952" Jul 21 15:03:34.205460 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:34.205420 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:34.205630 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:34.205578 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 15:03:34.205675 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:34.205642 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls podName:6cf9eb49-dfa2-412a-a656-8a5f758d340b nodeName:}" failed. No retries permitted until 2026-07-21 15:03:38.205626235 +0000 UTC m=+241.207880600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-df5ws" (UID: "6cf9eb49-dfa2-412a-a656-8a5f758d340b") : secret "samples-operator-tls" not found Jul 21 15:03:34.261430 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:34.261400 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:34.362302 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:34.362270 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:35.646364 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:35.646321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:35.709013 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:35.708989 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:36.505804 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.505771 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4vt9"] Jul 21 15:03:36.508227 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.508207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.510607 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.510572 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 21 15:03:36.510607 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.510608 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vz8nb\"" Jul 21 15:03:36.510893 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.510876 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 21 15:03:36.511461 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.511443 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 21 15:03:36.511461 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.511451 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 21 15:03:36.518694 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.518672 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4vt9"] Jul 21 15:03:36.522240 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.522213 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-cabundle\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.522345 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.522282 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-key\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.522345 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.522312 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7p8\" (UniqueName: \"kubernetes.io/projected/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-kube-api-access-wl7p8\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.550278 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.550239 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:36.608246 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.608222 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:36.623404 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.623371 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-cabundle\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.623506 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.623434 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-key\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.623506 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.623459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7p8\" (UniqueName: \"kubernetes.io/projected/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-kube-api-access-wl7p8\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.624053 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.624031 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-cabundle\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.625948 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.625928 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-signing-key\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.631502 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.631481 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7p8\" (UniqueName: \"kubernetes.io/projected/edefc56f-0eed-4cc4-8f3a-7f2bcc092874-kube-api-access-wl7p8\") pod \"service-ca-58598695f7-f4vt9\" (UID: \"edefc56f-0eed-4cc4-8f3a-7f2bcc092874\") " pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.686321 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.686287 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nvh7z"] Jul 21 15:03:36.688659 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.688638 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.691195 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.691172 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 15:03:36.691308 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.691237 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zxxxn\"" Jul 21 15:03:36.691408 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.691391 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 15:03:36.691472 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.691419 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 15:03:36.691472 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.691432 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 15:03:36.699293 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.699268 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nvh7z"] Jul 21 15:03:36.723781 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.723753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9f7\" (UniqueName: \"kubernetes.io/projected/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-api-access-rm9f7\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.724015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.723805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/471ed043-840d-4c11-ad12-7908e9b7b6de-crio-socket\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.724015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.723823 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/471ed043-840d-4c11-ad12-7908e9b7b6de-data-volume\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.724015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.723862 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.724015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.723925 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.724362 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.724341 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:36.803863 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.803780 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:36.816812 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.816786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f4vt9" Jul 21 15:03:36.824167 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824120 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824297 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824214 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824297 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824250 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9f7\" (UniqueName: \"kubernetes.io/projected/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-api-access-rm9f7\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824297 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:36.824284 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:03:36.824297 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/471ed043-840d-4c11-ad12-7908e9b7b6de-crio-socket\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824317 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/471ed043-840d-4c11-ad12-7908e9b7b6de-data-volume\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824508 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:36.824326 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 15:03:36.824508 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:36.824356 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:37.324335539 +0000 UTC m=+240.326589918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : secret "insights-runtime-extractor-tls" not found Jul 21 15:03:36.824508 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:36.824419 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:37.324400124 +0000 UTC m=+240.326654493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : configmap "kube-rbac-proxy" not found Jul 21 15:03:36.824508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824439 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/471ed043-840d-4c11-ad12-7908e9b7b6de-crio-socket\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.824740 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.824664 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/471ed043-840d-4c11-ad12-7908e9b7b6de-data-volume\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.834729 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.834693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9f7\" (UniqueName: \"kubernetes.io/projected/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-api-access-rm9f7\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:36.944526 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:36.944481 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4vt9"] Jul 21 15:03:36.947413 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:03:36.947392 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedefc56f_0eed_4cc4_8f3a_7f2bcc092874.slice/crio-288a1c529e76d2739637cb75db4f8995cdba0214341285778e941439e1214027 WatchSource:0}: Error finding container 288a1c529e76d2739637cb75db4f8995cdba0214341285778e941439e1214027: Status 404 returned error can't find the container with id 288a1c529e76d2739637cb75db4f8995cdba0214341285778e941439e1214027 Jul 21 15:03:37.317266 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:37.317227 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f4vt9" event={"ID":"edefc56f-0eed-4cc4-8f3a-7f2bcc092874","Type":"ContainerStarted","Data":"6068cf051bc08b9d42bfaa8e047b2e8831f9ad37d2f6ebf7cc75857a309a99a9"} Jul 21 15:03:37.317470 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:37.317285 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f4vt9" event={"ID":"edefc56f-0eed-4cc4-8f3a-7f2bcc092874","Type":"ContainerStarted","Data":"288a1c529e76d2739637cb75db4f8995cdba0214341285778e941439e1214027"} Jul 21 15:03:37.327234 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:37.327204 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:37.327395 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:37.327268 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:37.327395 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:37.327334 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 15:03:37.327395 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:37.327344 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:03:37.327395 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:37.327383 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:38.327364402 +0000 UTC m=+241.329618767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : configmap "kube-rbac-proxy" not found Jul 21 15:03:37.327600 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:37.327407 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:38.327390889 +0000 UTC m=+241.329645264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : secret "insights-runtime-extractor-tls" not found Jul 21 15:03:37.774168 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:37.774115 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:38.235673 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.235631 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:38.235883 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.235785 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 15:03:38.235883 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.235852 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls podName:6cf9eb49-dfa2-412a-a656-8a5f758d340b nodeName:}" failed. No retries permitted until 2026-07-21 15:03:46.235832713 +0000 UTC m=+249.238087084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-df5ws" (UID: "6cf9eb49-dfa2-412a-a656-8a5f758d340b") : secret "samples-operator-tls" not found Jul 21 15:03:38.272680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.272649 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.336290 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.336387 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.336446 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.336460 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.336515 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:40.336496621 +0000 UTC m=+243.338751002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : configmap "kube-rbac-proxy" not found Jul 21 15:03:38.336732 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:38.336533 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:40.336523681 +0000 UTC m=+243.338778046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : secret "insights-runtime-extractor-tls" not found Jul 21 15:03:38.452196 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.452168 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:38.551942 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.551835 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:38.651426 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.651387 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:38.997766 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:38.997731 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:39.477935 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:39.477910 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h54f7_c68ffdc1-d2af-4ab9-bd1b-50458cb0287a/dns-node-resolver/0.log" Jul 21 15:03:39.963110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:39.963080 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:40.277422 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.277347 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-875xh_29ffa9eb-a8ab-4500-a6d7-2b2958b12da4/node-ca/0.log" Jul 21 15:03:40.353044 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.353006 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:40.353226 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.353073 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:40.353226 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:40.353158 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:03:40.353226 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:40.353201 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 15:03:40.353335 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:40.353232 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:44.353214453 +0000 UTC m=+247.355468820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : secret "insights-runtime-extractor-tls" not found Jul 21 15:03:40.353335 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:40.353288 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:44.353274316 +0000 UTC m=+247.355528685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : configmap "kube-rbac-proxy" not found Jul 21 15:03:40.378347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.378318 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:40.587165 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.587059 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:40.694937 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.694895 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:40.796222 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.796138 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:40.996378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:40.996347 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:41.074308 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:41.074277 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xfx8_f980dc71-0dbc-49a1-8543-bde8f8fb8fb5/serve-healthcheck-canary/0.log" Jul 21 15:03:41.572937 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:41.572904 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:42.127822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:42.127789 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:42.309303 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:42.309257 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:42.752924 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:42.752897 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:42.819499 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:42.819471 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:42.964462 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:42.964425 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:43.962105 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:43.962077 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:44.388732 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:44.388696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:44.388888 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:44.388809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:44.388888 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:44.388829 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 15:03:44.388979 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:44.388894 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:52.388877785 +0000 UTC m=+255.391132150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : configmap "kube-rbac-proxy" not found Jul 21 15:03:44.388979 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:44.388931 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:03:44.389048 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:44.389003 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls podName:471ed043-840d-4c11-ad12-7908e9b7b6de nodeName:}" failed. No retries permitted until 2026-07-21 15:03:52.388987137 +0000 UTC m=+255.391241508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvh7z" (UID: "471ed043-840d-4c11-ad12-7908e9b7b6de") : secret "insights-runtime-extractor-tls" not found Jul 21 15:03:44.478332 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:44.478303 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:44.579286 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:44.579252 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:44.755930 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:44.755848 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:45.560281 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:45.560248 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:45.762107 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:45.762054 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:46.246210 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.246179 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:46.302464 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.302425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:46.305060 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.305027 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cf9eb49-dfa2-412a-a656-8a5f758d340b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-df5ws\" (UID: \"6cf9eb49-dfa2-412a-a656-8a5f758d340b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:46.348289 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.348258 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q476b\"" Jul 21 15:03:46.356106 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.356087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" Jul 21 15:03:46.357118 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.357093 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:46.488276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.488177 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-f4vt9" podStartSLOduration=10.488136782 podStartE2EDuration="10.488136782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:37.333102989 +0000 UTC m=+240.335357375" watchObservedRunningTime="2026-07-21 15:03:46.488136782 +0000 UTC m=+249.490391170" Jul 21 15:03:46.488457 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.488361 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws"] Jul 21 15:03:46.768784 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.768705 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:46.826751 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.826723 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:46.969486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:46.969456 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:47.348399 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:47.348360 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" event={"ID":"6cf9eb49-dfa2-412a-a656-8a5f758d340b","Type":"ContainerStarted","Data":"c8c98d6e2e2e7aadcc802bf750a41f40871bd3ef8423e4066e61dd2b6088a2d8"} Jul 21 15:03:47.364222 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:47.364188 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:47.775142 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:47.775058 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:47.869452 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:47.869406 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.165935 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.165893 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.365422 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.365390 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.578496 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.578465 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.680623 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.680543 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.807495 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.807462 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:48.967104 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:48.967016 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:49.326130 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.326036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:03:49.328514 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.328480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8529b685-aecf-4eeb-a3cd-538037c7732e-metrics-certs\") pod \"network-metrics-daemon-kvkmn\" (UID: \"8529b685-aecf-4eeb-a3cd-538037c7732e\") " pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:03:49.355441 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.355405 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" event={"ID":"6cf9eb49-dfa2-412a-a656-8a5f758d340b","Type":"ContainerStarted","Data":"dbea89bb460dab3cbe23becec31fde545f3b5ce1b16df881a15a66834a8cec66"} Jul 21 15:03:49.355608 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.355480 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" event={"ID":"6cf9eb49-dfa2-412a-a656-8a5f758d340b","Type":"ContainerStarted","Data":"141ba135ede806a407be7d87426af42b88b97dd02e30c1c3e05d4c9d576ae2ec"} Jul 21 15:03:49.373912 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.373863 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-df5ws" podStartSLOduration=17.498817121 podStartE2EDuration="19.373845934s" totalImagesPullingTime="1.875028813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:49.373164293 +0000 UTC m=+252.375418670" watchObservedRunningTime="2026-07-21 15:03:49.373845934 +0000 UTC m=+252.376100344" Jul 21 15:03:49.381938 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.381894 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:49.452093 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.452065 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2gv2\"" Jul 21 15:03:49.460337 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.460315 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvkmn" Jul 21 15:03:49.588977 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:49.588901 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kvkmn"] Jul 21 15:03:49.591955 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:03:49.591932 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8529b685_aecf_4eeb_a3cd_538037c7732e.slice/crio-4530257bea2d7a96e23b051cc50b6fc67cff66c3fe49d8a7f9a52513bec27a59 WatchSource:0}: Error finding container 4530257bea2d7a96e23b051cc50b6fc67cff66c3fe49d8a7f9a52513bec27a59: Status 404 returned error can't find the container with id 4530257bea2d7a96e23b051cc50b6fc67cff66c3fe49d8a7f9a52513bec27a59 Jul 21 15:03:50.359325 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:50.359294 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvkmn" event={"ID":"8529b685-aecf-4eeb-a3cd-538037c7732e","Type":"ContainerStarted","Data":"4530257bea2d7a96e23b051cc50b6fc67cff66c3fe49d8a7f9a52513bec27a59"} Jul 21 15:03:52.448632 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.448579 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:52.448632 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.448645 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:52.449127 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.449096 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/471ed043-840d-4c11-ad12-7908e9b7b6de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:52.451253 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.451237 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/471ed043-840d-4c11-ad12-7908e9b7b6de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvh7z\" (UID: \"471ed043-840d-4c11-ad12-7908e9b7b6de\") " pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:52.599850 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.599819 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zxxxn\"" Jul 21 15:03:52.607720 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.607698 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nvh7z" Jul 21 15:03:52.743457 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:52.743385 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nvh7z"] Jul 21 15:03:52.746664 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:03:52.746639 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471ed043_840d_4c11_ad12_7908e9b7b6de.slice/crio-a9bc8c8fa1b6df2674af32ec2c680bf1c8431398257fbfb98a37a0fbf8687d44 WatchSource:0}: Error finding container a9bc8c8fa1b6df2674af32ec2c680bf1c8431398257fbfb98a37a0fbf8687d44: Status 404 returned error can't find the container with id a9bc8c8fa1b6df2674af32ec2c680bf1c8431398257fbfb98a37a0fbf8687d44 Jul 21 15:03:53.027866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.027833 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:53.091195 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.091168 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:53.188031 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.188003 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:53.368532 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.368490 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvh7z" event={"ID":"471ed043-840d-4c11-ad12-7908e9b7b6de","Type":"ContainerStarted","Data":"a9bc8c8fa1b6df2674af32ec2c680bf1c8431398257fbfb98a37a0fbf8687d44"} Jul 21 15:03:53.369973 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.369949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvkmn" event={"ID":"8529b685-aecf-4eeb-a3cd-538037c7732e","Type":"ContainerStarted","Data":"21e4fa27a1592a4744a73e2c957cde2347a07d7f646e945b541b6137f5925dc4"} Jul 21 15:03:53.370079 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.369990 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvkmn" event={"ID":"8529b685-aecf-4eeb-a3cd-538037c7732e","Type":"ContainerStarted","Data":"0f15653f1903370ec98eba32b025e2d369b26cca7c1d5a02da634eb65b1b4569"} Jul 21 15:03:53.376637 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.376620 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:53.388372 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.388335 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kvkmn" podStartSLOduration=252.991251967 podStartE2EDuration="4m16.38832017s" totalImagesPullingTime="3.397068203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:53.387587238 +0000 UTC m=+256.389841625" watchObservedRunningTime="2026-07-21 15:03:53.38832017 +0000 UTC m=+256.390574550" Jul 21 15:03:53.499734 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.499702 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:53.599636 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:53.599606 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.015866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.015834 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.116477 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.116446 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.297830 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.297757 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.356520 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.356494 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.713787 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.713749 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:54.909194 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:54.909094 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:55.095740 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:55.095670 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:55.151967 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:55.151932 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:56.123418 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:56.123377 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:56.177907 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:56.177871 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:58.196821 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.196745 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b566c7dc-lmmsl"] Jul 21 15:03:58.197204 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:03:58.196925 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" podUID="e8bf8563-1030-486c-bb2c-37b14f1b8926" Jul 21 15:03:58.274407 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.274370 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7884d9875b-ncdcg"] Jul 21 15:03:58.277003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.276983 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.290787 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.290748 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:03:58.299809 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.299779 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7884d9875b-ncdcg"] Jul 21 15:03:58.387873 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.387840 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:03:58.396879 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.396847 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-image-registry-private-configuration\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.396884 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-bound-sa-token\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.396916 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-trusted-ca\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.396939 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-installation-pull-secrets\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.396999 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-tls\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397275 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.397049 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-certificates\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397275 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.397092 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-ca-trust-extracted\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.397275 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.397174 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txx2\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-kube-api-access-6txx2\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.398364 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.398346 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:03:58.497801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.497725 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.497801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.497800 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498051 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.497837 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498051 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.497881 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv55l\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498051 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.497909 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498241 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498178 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498241 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498220 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets\") pod \"e8bf8563-1030-486c-bb2c-37b14f1b8926\" (UID: \"e8bf8563-1030-486c-bb2c-37b14f1b8926\") " Jul 21 15:03:58.498361 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498305 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:58.498400 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-tls\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498433 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-certificates\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498448 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-ca-trust-extracted\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498499 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498470 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:58.498558 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txx2\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-kube-api-access-6txx2\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498596 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-image-registry-private-configuration\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498647 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498614 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-bound-sa-token\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498697 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498641 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:58.498697 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-trusted-ca\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498697 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-installation-pull-secrets\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.498827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498756 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-trusted-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.498827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498773 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-certificates\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.498827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498788 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8bf8563-1030-486c-bb2c-37b14f1b8926-ca-trust-extracted\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.498966 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.498822 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-ca-trust-extracted\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.499806 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.499760 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-certificates\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.500304 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.500276 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-trusted-ca\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.501962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.501937 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-installation-pull-secrets\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.502254 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.502198 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:03:58.502254 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.502193 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:03:58.502425 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.502258 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-registry-tls\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.502487 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.502462 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l" (OuterVolumeSpecName: "kube-api-access-sv55l") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "kube-api-access-sv55l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:03:58.502649 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.502605 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e8bf8563-1030-486c-bb2c-37b14f1b8926" (UID: "e8bf8563-1030-486c-bb2c-37b14f1b8926"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:03:58.503680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.503656 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-image-registry-private-configuration\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.510520 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.510468 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txx2\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-kube-api-access-6txx2\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.510945 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.510912 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7826ceb6-5e10-48cc-8d1c-5dc16c0281fa-bound-sa-token\") pod \"image-registry-7884d9875b-ncdcg\" (UID: \"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa\") " pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.591634 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.591606 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q548f\"" Jul 21 15:03:58.599772 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.599745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:58.600039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.600014 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv55l\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-kube-api-access-sv55l\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.600175 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.600045 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-image-registry-private-configuration\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.600175 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.600060 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8bf8563-1030-486c-bb2c-37b14f1b8926-installation-pull-secrets\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:58.600175 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:58.600074 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-bound-sa-token\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:03:59.015003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.014948 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7884d9875b-ncdcg"] Jul 21 15:03:59.019714 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:03:59.019685 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7826ceb6_5e10_48cc_8d1c_5dc16c0281fa.slice/crio-3e47723fc194797484ec6dffee62be8fa4baa33f5aa47ed95dcc6cddd6ff5ac9 WatchSource:0}: Error finding container 3e47723fc194797484ec6dffee62be8fa4baa33f5aa47ed95dcc6cddd6ff5ac9: Status 404 returned error can't find the container with id 3e47723fc194797484ec6dffee62be8fa4baa33f5aa47ed95dcc6cddd6ff5ac9 Jul 21 15:03:59.392776 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.392740 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvh7z" event={"ID":"471ed043-840d-4c11-ad12-7908e9b7b6de","Type":"ContainerStarted","Data":"6ed3a4a26831581eaa5a3e7229ba7178ab7c58b49f6044b259e5f218791ddc17"} Jul 21 15:03:59.394319 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.394284 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" event={"ID":"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa","Type":"ContainerStarted","Data":"42eec1954ed3542da5f4b37e3301be28ad42d44dc4efb49bad4f611c6d02346b"} Jul 21 15:03:59.394411 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.394332 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" event={"ID":"7826ceb6-5e10-48cc-8d1c-5dc16c0281fa","Type":"ContainerStarted","Data":"3e47723fc194797484ec6dffee62be8fa4baa33f5aa47ed95dcc6cddd6ff5ac9"} Jul 21 15:03:59.394411 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.394345 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b566c7dc-lmmsl" Jul 21 15:03:59.394492 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.394454 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:03:59.445727 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.445680 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" podStartSLOduration=1.445664552 podStartE2EDuration="1.445664552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:59.444383707 +0000 UTC m=+262.446638095" watchObservedRunningTime="2026-07-21 15:03:59.445664552 +0000 UTC m=+262.447918917" Jul 21 15:03:59.479869 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.479840 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b566c7dc-lmmsl"] Jul 21 15:03:59.483866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.483843 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86b566c7dc-lmmsl"] Jul 21 15:03:59.552652 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.552550 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8bf8563-1030-486c-bb2c-37b14f1b8926" path="/var/lib/kubelet/pods/e8bf8563-1030-486c-bb2c-37b14f1b8926/volumes" Jul 21 15:03:59.606841 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:03:59.606809 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8bf8563-1030-486c-bb2c-37b14f1b8926-registry-tls\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:04:00.208756 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:00.208723 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:00.312050 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:00.312017 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:02.282072 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:02.282031 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:02.355520 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:02.355494 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:03.409462 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:03.409428 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvh7z" event={"ID":"471ed043-840d-4c11-ad12-7908e9b7b6de","Type":"ContainerStarted","Data":"580c914e23b8e1bb790cadc07cd17f10e5c733c973935b1b75bc94af7f5003dc"} Jul 21 15:04:04.013120 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:04.013081 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:04.088076 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:04.088040 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:04.986968 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:04.986935 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:07.424493 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:07.424462 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvh7z" event={"ID":"471ed043-840d-4c11-ad12-7908e9b7b6de","Type":"ContainerStarted","Data":"a9515cbfccd595efd89e0c732235b32c1611ece33e0ed12e15cf8794f87d5d84"} Jul 21 15:04:07.444703 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:07.444657 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nvh7z" podStartSLOduration=17.508919902 podStartE2EDuration="31.444640244s" totalImagesPullingTime="13.935720342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:03:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:07.443903972 +0000 UTC m=+270.446158360" watchObservedRunningTime="2026-07-21 15:04:07.444640244 +0000 UTC m=+270.446894631" Jul 21 15:04:08.128783 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:08.128748 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:09.434412 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:09.434378 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:11.730998 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:11.730960 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:11.800248 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:11.800223 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:12.149903 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.149874 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:12.387109 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.387071 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:12.420020 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.419946 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc"] Jul 21 15:04:12.423584 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.423566 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.427712 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.427689 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 15:04:12.427827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.427711 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 15:04:12.427876 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.427857 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 15:04:12.427977 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.427955 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vdcrm"] Jul 21 15:04:12.428471 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.428437 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 15:04:12.429569 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.429551 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 15:04:12.429834 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.429813 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q7st4\"" Jul 21 15:04:12.431659 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.431453 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r6t2b"] Jul 21 15:04:12.431943 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.431922 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.434374 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.434317 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 15:04:12.434374 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.434366 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 15:04:12.434797 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.434750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.434897 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.434878 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5j684\"" Jul 21 15:04:12.435242 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.435227 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 15:04:12.437856 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.437837 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc"] Jul 21 15:04:12.438301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.438284 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 15:04:12.438446 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.438306 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 15:04:12.438508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.438462 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4zq7c\"" Jul 21 15:04:12.438801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.438775 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 15:04:12.447846 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.447826 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r6t2b"] Jul 21 15:04:12.487962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.487934 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:12.512475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-root\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512473 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.512689 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.512689 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512515 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5l9\" (UniqueName: \"kubernetes.io/projected/b4e69a01-5838-4006-9c5b-6a83a3479212-kube-api-access-qm5l9\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512689 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512553 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce931326-b4d4-462a-ae6c-aee202277fee-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.512689 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512629 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-sys\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512689 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512685 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-metrics-client-ca\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512723 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512743 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512792 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-tls\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512822 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-accelerators-collector-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512888 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bcf4\" (UniqueName: \"kubernetes.io/projected/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-api-access-2bcf4\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512906 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.512972 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.513421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512980 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8jbf\" (UniqueName: \"kubernetes.io/projected/ce931326-b4d4-462a-ae6c-aee202277fee-kube-api-access-m8jbf\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.513421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.512998 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-textfile\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.513421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.513013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-wtmp\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.552827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.552797 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:12.613888 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.613863 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5l9\" (UniqueName: \"kubernetes.io/projected/b4e69a01-5838-4006-9c5b-6a83a3479212-kube-api-access-qm5l9\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.613892 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce931326-b4d4-462a-ae6c-aee202277fee-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.614039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.613917 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-sys\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.613966 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-metrics-client-ca\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.613992 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.614039 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614018 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614062 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-sys\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614166 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614211 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-tls\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614244 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-accelerators-collector-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.614318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614302 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bcf4\" (UniqueName: \"kubernetes.io/projected/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-api-access-2bcf4\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614332 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614358 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8jbf\" (UniqueName: \"kubernetes.io/projected/ce931326-b4d4-462a-ae6c-aee202277fee-kube-api-access-m8jbf\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614426 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-textfile\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-wtmp\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614487 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-root\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614510 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.614622 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614536 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.615205 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.614720 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce931326-b4d4-462a-ae6c-aee202277fee-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.615205 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-textfile\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.615310 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615290 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.615439 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615417 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-accelerators-collector-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.615497 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615464 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.615497 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615474 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-root\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.615497 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.615426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-wtmp\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.616270 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.616243 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.616380 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.616362 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e69a01-5838-4006-9c5b-6a83a3479212-metrics-client-ca\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.617338 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.617310 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.617431 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.617414 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.617490 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.617461 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce931326-b4d4-462a-ae6c-aee202277fee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.618316 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.618288 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.618601 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.618580 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-tls\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.618734 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.618709 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e69a01-5838-4006-9c5b-6a83a3479212-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.623951 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.623928 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8jbf\" (UniqueName: \"kubernetes.io/projected/ce931326-b4d4-462a-ae6c-aee202277fee-kube-api-access-m8jbf\") pod \"openshift-state-metrics-79f6958cdf-78ggc\" (UID: \"ce931326-b4d4-462a-ae6c-aee202277fee\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.624332 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.624312 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5l9\" (UniqueName: \"kubernetes.io/projected/b4e69a01-5838-4006-9c5b-6a83a3479212-kube-api-access-qm5l9\") pod \"node-exporter-vdcrm\" (UID: \"b4e69a01-5838-4006-9c5b-6a83a3479212\") " pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.627629 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.627610 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bcf4\" (UniqueName: \"kubernetes.io/projected/a2fc2ef9-e4d1-4381-9407-2049cbab9f85-kube-api-access-2bcf4\") pod \"kube-state-metrics-56c5594674-r6t2b\" (UID: \"a2fc2ef9-e4d1-4381-9407-2049cbab9f85\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.736301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.736228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" Jul 21 15:04:12.745850 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.745830 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vdcrm" Jul 21 15:04:12.752810 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.752786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" Jul 21 15:04:12.756293 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:12.756271 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e69a01_5838_4006_9c5b_6a83a3479212.slice/crio-d3972d7f7504806aaf9122504aca912104645a565ad5b869be04b79539bc7ac7 WatchSource:0}: Error finding container d3972d7f7504806aaf9122504aca912104645a565ad5b869be04b79539bc7ac7: Status 404 returned error can't find the container with id d3972d7f7504806aaf9122504aca912104645a565ad5b869be04b79539bc7ac7 Jul 21 15:04:12.910548 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.910525 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc"] Jul 21 15:04:12.913176 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:12.913134 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce931326_b4d4_462a_ae6c_aee202277fee.slice/crio-9e2f9f0a4240e7a23c039d9fe6a688e25afd53602dc7206a204eaf76eb139927 WatchSource:0}: Error finding container 9e2f9f0a4240e7a23c039d9fe6a688e25afd53602dc7206a204eaf76eb139927: Status 404 returned error can't find the container with id 9e2f9f0a4240e7a23c039d9fe6a688e25afd53602dc7206a204eaf76eb139927 Jul 21 15:04:12.930283 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:12.930255 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r6t2b"] Jul 21 15:04:12.933208 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:12.933179 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fc2ef9_e4d1_4381_9407_2049cbab9f85.slice/crio-09c16b6b0072c4a42d1c341c5b80851370a4b4a776b0a5a1ae00569c7ce1a2c0 WatchSource:0}: Error finding container 09c16b6b0072c4a42d1c341c5b80851370a4b4a776b0a5a1ae00569c7ce1a2c0: Status 404 returned error can't find the container with id 09c16b6b0072c4a42d1c341c5b80851370a4b4a776b0a5a1ae00569c7ce1a2c0 Jul 21 15:04:13.387768 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.387717 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:13.447236 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.447184 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vdcrm" event={"ID":"b4e69a01-5838-4006-9c5b-6a83a3479212","Type":"ContainerStarted","Data":"d3972d7f7504806aaf9122504aca912104645a565ad5b869be04b79539bc7ac7"} Jul 21 15:04:13.449319 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.449288 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" event={"ID":"ce931326-b4d4-462a-ae6c-aee202277fee","Type":"ContainerStarted","Data":"c96bfdcafeb363e70de15dd8469676b2d23675da070691ddbc7fa03c8c7d454a"} Jul 21 15:04:13.449461 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.449350 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" event={"ID":"ce931326-b4d4-462a-ae6c-aee202277fee","Type":"ContainerStarted","Data":"de5f882c4bba8ece0f9f51974caa6dcbda7b02d8c824219c5050d82cf668f360"} Jul 21 15:04:13.449461 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.449378 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" event={"ID":"ce931326-b4d4-462a-ae6c-aee202277fee","Type":"ContainerStarted","Data":"9e2f9f0a4240e7a23c039d9fe6a688e25afd53602dc7206a204eaf76eb139927"} Jul 21 15:04:13.450423 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.450402 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" event={"ID":"a2fc2ef9-e4d1-4381-9407-2049cbab9f85","Type":"ContainerStarted","Data":"09c16b6b0072c4a42d1c341c5b80851370a4b4a776b0a5a1ae00569c7ce1a2c0"} Jul 21 15:04:13.476742 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.476710 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:04:13.480508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.480487 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.484360 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.484339 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 15:04:13.484912 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.484895 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 15:04:13.485006 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.484919 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 15:04:13.485115 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485092 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 15:04:13.485196 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485186 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 15:04:13.485441 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485260 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2vkf7\"" Jul 21 15:04:13.485441 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485417 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 15:04:13.485576 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485458 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 15:04:13.485641 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485624 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 15:04:13.485698 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.485656 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 15:04:13.486539 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.486518 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:13.500116 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.500097 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:04:13.623821 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623832 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623855 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623878 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623908 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623947 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.623988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623976 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.623996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.624022 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.624073 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.624101 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.624215 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48f6f\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.624315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.624270 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725137 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725055 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725137 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725259 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725286 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725313 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725367 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725379 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:04:13.725376 2585 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 21 15:04:13.725822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725418 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.725822 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:04:13.725444 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls podName:d8183ac0-776a-4b15-8575-cb8e47766869 nodeName:}" failed. No retries permitted until 2026-07-21 15:04:14.225424074 +0000 UTC m=+277.227678438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869") : secret "alertmanager-main-tls" not found Jul 21 15:04:13.725822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.725509 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48f6f\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.726903 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.726473 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.727128 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.727102 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.728037 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.727930 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.728429 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.728403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.730597 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.730572 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.730902 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.730859 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.731005 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.730989 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.732047 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.731480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.732047 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.732009 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.733665 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.733642 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.734399 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.734360 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:13.737754 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:13.737730 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48f6f\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:14.000238 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.000197 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:14.080461 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.080431 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:14.230178 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.230065 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:14.233139 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.233111 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:14.392932 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.392898 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:04:14.456990 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.456856 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4e69a01-5838-4006-9c5b-6a83a3479212" containerID="4ba417fbf7e6ac965063b3b7fc1ef991d978ec7566d3ccee29c4507bd8f60c11" exitCode=0 Jul 21 15:04:14.457138 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.457004 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vdcrm" event={"ID":"b4e69a01-5838-4006-9c5b-6a83a3479212","Type":"ContainerDied","Data":"4ba417fbf7e6ac965063b3b7fc1ef991d978ec7566d3ccee29c4507bd8f60c11"} Jul 21 15:04:14.563364 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:14.563284 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:04:14.566252 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:14.566230 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8183ac0_776a_4b15_8575_cb8e47766869.slice/crio-e0d4fce77aeec14f9b0347b7db77879e1f1ce6fa0deb15a7064c35875ae5e83b WatchSource:0}: Error finding container e0d4fce77aeec14f9b0347b7db77879e1f1ce6fa0deb15a7064c35875ae5e83b: Status 404 returned error can't find the container with id e0d4fce77aeec14f9b0347b7db77879e1f1ce6fa0deb15a7064c35875ae5e83b Jul 21 15:04:15.466262 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.465602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vdcrm" event={"ID":"b4e69a01-5838-4006-9c5b-6a83a3479212","Type":"ContainerStarted","Data":"db2e91073de80e913a53706dcd7ff35bfb850581cc2ff35d2f6bdebb67b62d91"} Jul 21 15:04:15.466262 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.465704 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vdcrm" event={"ID":"b4e69a01-5838-4006-9c5b-6a83a3479212","Type":"ContainerStarted","Data":"6c005af93be070b6c3b564ed5b828f50d866c35432ddd0a5aa1723bea195697b"} Jul 21 15:04:15.468112 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.468085 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" event={"ID":"ce931326-b4d4-462a-ae6c-aee202277fee","Type":"ContainerStarted","Data":"41b843674bb23de2cab6e1db47ca6a698cef1abd9e3e3ac4360f026fd1eed3b5"} Jul 21 15:04:15.470996 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.470976 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" event={"ID":"a2fc2ef9-e4d1-4381-9407-2049cbab9f85","Type":"ContainerStarted","Data":"6b45ed57108b2761c878d1e4707493ba8a3f1cc56dc8d64bfdc1d323c63e10a6"} Jul 21 15:04:15.471112 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.471018 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" event={"ID":"a2fc2ef9-e4d1-4381-9407-2049cbab9f85","Type":"ContainerStarted","Data":"3c944efd0935e6334d4f32bdad6a7e0d97e3d2c49aa57816b633965b47c47026"} Jul 21 15:04:15.471112 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.471044 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" event={"ID":"a2fc2ef9-e4d1-4381-9407-2049cbab9f85","Type":"ContainerStarted","Data":"b5c67c3e10c1871cfccbc20cf275dd584166e6d374c48980c704f3b6b7adbc98"} Jul 21 15:04:15.472557 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.472530 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"e0d4fce77aeec14f9b0347b7db77879e1f1ce6fa0deb15a7064c35875ae5e83b"} Jul 21 15:04:15.490017 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.489963 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vdcrm" podStartSLOduration=2.351559909 podStartE2EDuration="3.489944297s" totalImagesPullingTime="1.061581425s" totalInitContainerRuntime="76.802963ms" isStatefulPod=true podCreationTimestamp="2026-07-21 15:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:15.487754014 +0000 UTC m=+278.490008405" watchObservedRunningTime="2026-07-21 15:04:15.489944297 +0000 UTC m=+278.492198686" Jul 21 15:04:15.509357 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.509308 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-78ggc" podStartSLOduration=2.094091976 podStartE2EDuration="3.509293594s" totalImagesPullingTime="1.415201618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:15.508939131 +0000 UTC m=+278.511193519" watchObservedRunningTime="2026-07-21 15:04:15.509293594 +0000 UTC m=+278.511547980" Jul 21 15:04:15.531272 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:15.531216 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-r6t2b" podStartSLOduration=1.483174173 podStartE2EDuration="3.531195535s" totalImagesPullingTime="2.048021362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:15.529873819 +0000 UTC m=+278.532128209" watchObservedRunningTime="2026-07-21 15:04:15.531195535 +0000 UTC m=+278.533449922" Jul 21 15:04:16.085090 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.084998 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:16.148546 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.148500 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:16.477168 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.477112 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d" exitCode=0 Jul 21 15:04:16.477530 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.477218 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d"} Jul 21 15:04:16.802856 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.802780 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5db946b6d6-mzcp2"] Jul 21 15:04:16.805961 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.805941 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.808465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.808442 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kt9t2\"" Jul 21 15:04:16.808569 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.808543 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-djuguu304chkf\"" Jul 21 15:04:16.809396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.809378 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 15:04:16.809491 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.809441 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 15:04:16.809491 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.809467 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 15:04:16.809581 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.809524 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 15:04:16.816815 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.816796 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db946b6d6-mzcp2"] Jul 21 15:04:16.953224 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953184 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953244 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-client-certs\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-audit-log\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-metrics-server-audit-profiles\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953320 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-tls\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953378 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953369 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6x6\" (UniqueName: \"kubernetes.io/projected/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-kube-api-access-zg6x6\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:16.953563 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:16.953403 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-client-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-audit-log\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054613 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-metrics-server-audit-profiles\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054634 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-tls\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6x6\" (UniqueName: \"kubernetes.io/projected/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-kube-api-access-zg6x6\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054922 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-client-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054922 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054707 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.054922 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.054735 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-client-certs\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.055110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.055060 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-audit-log\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.055415 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.055391 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.055621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.055603 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-metrics-server-audit-profiles\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.057227 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.057208 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-client-ca-bundle\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.057873 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.057849 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-client-certs\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.057941 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.057879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-secret-metrics-server-tls\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.063359 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.063342 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6x6\" (UniqueName: \"kubernetes.io/projected/3141b1d7-eb10-4f26-b5fe-a4947b90cc17-kube-api-access-zg6x6\") pod \"metrics-server-5db946b6d6-mzcp2\" (UID: \"3141b1d7-eb10-4f26-b5fe-a4947b90cc17\") " pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.115324 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.115296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:17.187119 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.187073 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:17.247607 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.247448 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db946b6d6-mzcp2"] Jul 21 15:04:17.250057 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:17.250028 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3141b1d7_eb10_4f26_b5fe_a4947b90cc17.slice/crio-e2dd782135ac5c49f2def63df1ae6cd9d2404c71f4c95b1c89c4339f97452e77 WatchSource:0}: Error finding container e2dd782135ac5c49f2def63df1ae6cd9d2404c71f4c95b1c89c4339f97452e77: Status 404 returned error can't find the container with id e2dd782135ac5c49f2def63df1ae6cd9d2404c71f4c95b1c89c4339f97452e77 Jul 21 15:04:17.256460 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.256439 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:17.386257 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.386234 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:17.482035 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:17.482000 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" event={"ID":"3141b1d7-eb10-4f26-b5fe-a4947b90cc17","Type":"ContainerStarted","Data":"e2dd782135ac5c49f2def63df1ae6cd9d2404c71f4c95b1c89c4339f97452e77"} Jul 21 15:04:18.146012 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:18.145958 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:18.220713 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:18.220678 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:18.604962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:18.604929 2585 patch_prober.go:28] interesting pod/image-registry-7884d9875b-ncdcg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 15:04:18.605323 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:18.604987 2585 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" podUID="7826ceb6-5e10-48cc-8d1c-5dc16c0281fa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 15:04:18.670696 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:18.670659 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:19.122077 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:04:19.122039 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sclfg" podUID="910bcdf3-7232-4eba-b6da-07c0d3925ef9" Jul 21 15:04:19.342401 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.342370 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:19.494005 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.493922 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b"} Jul 21 15:04:19.494005 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.493999 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594"} Jul 21 15:04:19.494238 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.494037 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047"} Jul 21 15:04:19.494238 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.494070 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660"} Jul 21 15:04:19.494238 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.494111 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7"} Jul 21 15:04:19.495399 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.495375 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" event={"ID":"3141b1d7-eb10-4f26-b5fe-a4947b90cc17","Type":"ContainerStarted","Data":"5728cba4479168939d80e9a7d19b214144ce92f3d45e03b9fdd0afc268f37b3e"} Jul 21 15:04:19.495512 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.495408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:19.513896 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.513755 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" podStartSLOduration=1.7884012889999998 podStartE2EDuration="3.513736482s" totalImagesPullingTime="1.725335193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:19.51345064 +0000 UTC m=+282.515705028" watchObservedRunningTime="2026-07-21 15:04:19.513736482 +0000 UTC m=+282.515990871" Jul 21 15:04:19.906433 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:19.906405 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:20.405093 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:20.405057 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7884d9875b-ncdcg" Jul 21 15:04:20.551849 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:20.551816 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:20.617307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:20.617279 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:20.942203 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:20.942085 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:21.506037 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:21.506008 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerStarted","Data":"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1"} Jul 21 15:04:21.541756 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:21.541701 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.535254234 podStartE2EDuration="8.541682809s" totalImagesPullingTime="4.991497192s" totalInitContainerRuntime="14.931383ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:21.541293242 +0000 UTC m=+284.543547631" watchObservedRunningTime="2026-07-21 15:04:21.541682809 +0000 UTC m=+284.543937196" Jul 21 15:04:21.666074 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:21.666040 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:21.768507 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:21.768428 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:21.883878 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:21.883850 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:22.265876 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.265841 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:22.327957 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.327925 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:22.402048 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.402013 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:22.404412 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.404385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/910bcdf3-7232-4eba-b6da-07c0d3925ef9-metrics-tls\") pod \"dns-default-sclfg\" (UID: \"910bcdf3-7232-4eba-b6da-07c0d3925ef9\") " pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:22.498564 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.498536 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhwsr\"" Jul 21 15:04:22.506845 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.506821 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:22.638365 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:22.638337 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sclfg"] Jul 21 15:04:22.641552 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:04:22.641524 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910bcdf3_7232_4eba_b6da_07c0d3925ef9.slice/crio-3a15eecb8634c9243a68ed631ba111480f015d5c34b86465bf4c1d558a2b1e48 WatchSource:0}: Error finding container 3a15eecb8634c9243a68ed631ba111480f015d5c34b86465bf4c1d558a2b1e48: Status 404 returned error can't find the container with id 3a15eecb8634c9243a68ed631ba111480f015d5c34b86465bf4c1d558a2b1e48 Jul 21 15:04:23.514791 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:23.514757 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sclfg" event={"ID":"910bcdf3-7232-4eba-b6da-07c0d3925ef9","Type":"ContainerStarted","Data":"3a15eecb8634c9243a68ed631ba111480f015d5c34b86465bf4c1d558a2b1e48"} Jul 21 15:04:23.734960 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:23.734926 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:23.798900 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:23.798819 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:24.520555 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:24.520532 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sclfg" event={"ID":"910bcdf3-7232-4eba-b6da-07c0d3925ef9","Type":"ContainerStarted","Data":"0e67893305d12ad2d036734b67f71abd6d0a6655703b5c4eedb77eda3b32663d"} Jul 21 15:04:25.525370 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:25.525339 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sclfg" event={"ID":"910bcdf3-7232-4eba-b6da-07c0d3925ef9","Type":"ContainerStarted","Data":"41da8d8f6c70ecf4d47283bc8372472733cd177e629d3e63b1f8c7d61c3c7f6f"} Jul 21 15:04:25.525715 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:25.525447 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:25.545427 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:25.545381 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sclfg" podStartSLOduration=251.826577097 podStartE2EDuration="4m13.545367606s" totalImagesPullingTime="1.718790509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:25.544478805 +0000 UTC m=+288.546733198" watchObservedRunningTime="2026-07-21 15:04:25.545367606 +0000 UTC m=+288.547621993" Jul 21 15:04:31.461229 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:31.461194 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:31.562037 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:31.562008 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:31.646339 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:31.646308 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:31.783408 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:31.783333 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:31.883577 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:31.883543 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:32.137688 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:32.137658 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:32.211260 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:32.211233 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:34.405195 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:34.405166 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:34.501765 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:34.501734 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:34.601342 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:34.601278 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:35.530775 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:35.530742 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sclfg" Jul 21 15:04:36.866437 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:36.866410 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:36.967090 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:36.967061 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:37.115984 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:37.115950 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:37.116174 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:37.116013 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:37.394765 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:37.394733 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:04:37.394945 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:37.394809 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:04:37.403000 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:37.402968 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 15:04:40.900608 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:40.900574 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:41.091362 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:41.091332 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:44.598482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:44.598448 2585 generic.go:356] "Generic (PLEG): container finished" podID="0299aaba-8e54-492c-b49e-9defcaa70a49" containerID="cf78269923b06e5c1ae5d0092dcbff0ba7f50b26ae760cea1a937553b7949650" exitCode=0 Jul 21 15:04:44.598851 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:44.598490 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" event={"ID":"0299aaba-8e54-492c-b49e-9defcaa70a49","Type":"ContainerDied","Data":"cf78269923b06e5c1ae5d0092dcbff0ba7f50b26ae760cea1a937553b7949650"} Jul 21 15:04:44.598851 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:44.598811 2585 scope.go:117] "RemoveContainer" containerID="cf78269923b06e5c1ae5d0092dcbff0ba7f50b26ae760cea1a937553b7949650" Jul 21 15:04:45.603670 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:45.603635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sqn9t" event={"ID":"0299aaba-8e54-492c-b49e-9defcaa70a49","Type":"ContainerStarted","Data":"7c1c1f9a3d47c61557471ad479bff2a37d005a59288d9aaac40ce466568e68e9"} Jul 21 15:04:45.660951 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:45.660924 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:47.152246 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:47.152216 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:47.211775 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:47.211746 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:55.716565 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:55.716535 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:55.819202 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:55.819171 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:04:57.121276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:57.121251 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:04:57.124948 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:04:57.124930 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5db946b6d6-mzcp2" Jul 21 15:05:02.142514 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:02.142483 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:02.201717 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:02.201691 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:25.627320 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:25.627287 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:25.694802 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:25.694755 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:31.606090 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:31.606009 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:31.712355 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:31.712320 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:32.700316 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700286 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:32.700699 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700585 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="alertmanager" containerID="cri-o://80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" gracePeriod=120 Jul 21 15:05:32.700699 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700652 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-metric" containerID="cri-o://5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" gracePeriod=120 Jul 21 15:05:32.700813 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700689 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-web" containerID="cri-o://a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" gracePeriod=120 Jul 21 15:05:32.700813 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700694 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="prom-label-proxy" containerID="cri-o://cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" gracePeriod=120 Jul 21 15:05:32.700813 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700716 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="config-reloader" containerID="cri-o://170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" gracePeriod=120 Jul 21 15:05:32.700813 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:32.700792 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy" containerID="cri-o://8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" gracePeriod=120 Jul 21 15:05:33.783181 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783133 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" exitCode=0 Jul 21 15:05:33.783181 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783180 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" exitCode=0 Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783186 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" exitCode=0 Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783179 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1"} Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783249 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594"} Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783192 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" exitCode=0 Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783288 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660"} Jul 21 15:05:33.783482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.783324 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7"} Jul 21 15:05:33.945574 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:33.945553 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.048111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048033 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048069 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48f6f\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048097 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048209 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048246 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048277 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048296 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048337 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048362 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048396 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048388 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048735 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048445 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048735 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048477 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048735 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048508 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config\") pod \"d8183ac0-776a-4b15-8575-cb8e47766869\" (UID: \"d8183ac0-776a-4b15-8575-cb8e47766869\") " Jul 21 15:05:34.048888 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.048825 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:05:34.049392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.049361 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:34.049654 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.049626 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:05:34.051101 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.051062 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.051233 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.051090 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f" (OuterVolumeSpecName: "kube-api-access-48f6f") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "kube-api-access-48f6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:34.052416 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.052383 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.052416 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.052406 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.052588 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.052478 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.052906 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.052883 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume" (OuterVolumeSpecName: "config-volume") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.053036 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.053015 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:34.053242 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.053219 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out" (OuterVolumeSpecName: "config-out") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:34.056266 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.056126 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.061775 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.061754 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config" (OuterVolumeSpecName: "web-config") pod "d8183ac0-776a-4b15-8575-cb8e47766869" (UID: "d8183ac0-776a-4b15-8575-cb8e47766869"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:05:34.149267 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149236 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-main-tls\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149267 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149263 2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149276 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149289 2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-alertmanager-main-db\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149301 2585 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-config-volume\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149312 2585 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-cluster-tls-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149324 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149335 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48f6f\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-kube-api-access-48f6f\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149368 2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-web-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149380 2585 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8183ac0-776a-4b15-8575-cb8e47766869-metrics-client-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149392 2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8183ac0-776a-4b15-8575-cb8e47766869-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149405 2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8183ac0-776a-4b15-8575-cb8e47766869-tls-assets\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.149465 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.149416 2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8183ac0-776a-4b15-8575-cb8e47766869-config-out\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:05:34.790167 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790121 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" exitCode=0 Jul 21 15:05:34.790167 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790163 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8183ac0-776a-4b15-8575-cb8e47766869" containerID="a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" exitCode=0 Jul 21 15:05:34.790619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790191 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b"} Jul 21 15:05:34.790619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790230 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.790619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790283 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047"} Jul 21 15:05:34.790619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790328 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8183ac0-776a-4b15-8575-cb8e47766869","Type":"ContainerDied","Data":"e0d4fce77aeec14f9b0347b7db77879e1f1ce6fa0deb15a7064c35875ae5e83b"} Jul 21 15:05:34.790619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.790347 2585 scope.go:117] "RemoveContainer" containerID="cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" Jul 21 15:05:34.798354 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.798336 2585 scope.go:117] "RemoveContainer" containerID="5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" Jul 21 15:05:34.805342 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.805325 2585 scope.go:117] "RemoveContainer" containerID="8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" Jul 21 15:05:34.811996 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.811821 2585 scope.go:117] "RemoveContainer" containerID="a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" Jul 21 15:05:34.814687 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.814665 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:34.820046 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.820023 2585 scope.go:117] "RemoveContainer" containerID="170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" Jul 21 15:05:34.821502 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.821484 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:34.826803 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.826790 2585 scope.go:117] "RemoveContainer" containerID="80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" Jul 21 15:05:34.833428 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.833400 2585 scope.go:117] "RemoveContainer" containerID="21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d" Jul 21 15:05:34.839815 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.839799 2585 scope.go:117] "RemoveContainer" containerID="cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" Jul 21 15:05:34.840074 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.840053 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1\": container with ID starting with cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1 not found: ID does not exist" containerID="cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" Jul 21 15:05:34.840127 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840083 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1"} err="failed to get container status \"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1\": rpc error: code = NotFound desc = could not find container \"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1\": container with ID starting with cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1 not found: ID does not exist" Jul 21 15:05:34.840127 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840112 2585 scope.go:117] "RemoveContainer" containerID="5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" Jul 21 15:05:34.840360 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.840345 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b\": container with ID starting with 5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b not found: ID does not exist" containerID="5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" Jul 21 15:05:34.840403 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840363 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b"} err="failed to get container status \"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b\": rpc error: code = NotFound desc = could not find container \"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b\": container with ID starting with 5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b not found: ID does not exist" Jul 21 15:05:34.840403 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840375 2585 scope.go:117] "RemoveContainer" containerID="8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" Jul 21 15:05:34.840572 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.840554 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594\": container with ID starting with 8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594 not found: ID does not exist" containerID="8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" Jul 21 15:05:34.840631 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840583 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594"} err="failed to get container status \"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594\": rpc error: code = NotFound desc = could not find container \"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594\": container with ID starting with 8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594 not found: ID does not exist" Jul 21 15:05:34.840631 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840608 2585 scope.go:117] "RemoveContainer" containerID="a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" Jul 21 15:05:34.840814 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.840799 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047\": container with ID starting with a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047 not found: ID does not exist" containerID="a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" Jul 21 15:05:34.840847 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840818 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047"} err="failed to get container status \"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047\": rpc error: code = NotFound desc = could not find container \"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047\": container with ID starting with a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047 not found: ID does not exist" Jul 21 15:05:34.840847 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.840829 2585 scope.go:117] "RemoveContainer" containerID="170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" Jul 21 15:05:34.841012 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.840996 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660\": container with ID starting with 170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660 not found: ID does not exist" containerID="170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" Jul 21 15:05:34.841071 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841018 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660"} err="failed to get container status \"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660\": rpc error: code = NotFound desc = could not find container \"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660\": container with ID starting with 170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660 not found: ID does not exist" Jul 21 15:05:34.841071 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841036 2585 scope.go:117] "RemoveContainer" containerID="80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" Jul 21 15:05:34.841246 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.841229 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7\": container with ID starting with 80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7 not found: ID does not exist" containerID="80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" Jul 21 15:05:34.841295 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841250 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7"} err="failed to get container status \"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7\": rpc error: code = NotFound desc = could not find container \"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7\": container with ID starting with 80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7 not found: ID does not exist" Jul 21 15:05:34.841295 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841262 2585 scope.go:117] "RemoveContainer" containerID="21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d" Jul 21 15:05:34.841430 ip-10-0-129-25 kubenswrapper[2585]: E0721 15:05:34.841413 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d\": container with ID starting with 21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d not found: ID does not exist" containerID="21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d" Jul 21 15:05:34.841475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841433 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d"} err="failed to get container status \"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d\": rpc error: code = NotFound desc = could not find container \"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d\": container with ID starting with 21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d not found: ID does not exist" Jul 21 15:05:34.841475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841445 2585 scope.go:117] "RemoveContainer" containerID="cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1" Jul 21 15:05:34.841644 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841626 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1"} err="failed to get container status \"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1\": rpc error: code = NotFound desc = could not find container \"cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1\": container with ID starting with cfc4a09536b97557942d2dcfd56fbc6a0a8766d03f7db803cf599a65d7a129a1 not found: ID does not exist" Jul 21 15:05:34.841714 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841645 2585 scope.go:117] "RemoveContainer" containerID="5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b" Jul 21 15:05:34.841854 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841839 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b"} err="failed to get container status \"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b\": rpc error: code = NotFound desc = could not find container \"5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b\": container with ID starting with 5cec19c7c4b8cec152f4f3bf21f9f7dd921f5b41625939cff94b7b20638aab3b not found: ID does not exist" Jul 21 15:05:34.841894 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.841853 2585 scope.go:117] "RemoveContainer" containerID="8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594" Jul 21 15:05:34.842056 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842039 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594"} err="failed to get container status \"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594\": rpc error: code = NotFound desc = could not find container \"8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594\": container with ID starting with 8f85e863318356067eee69130d1654e25ee4305ce378585f44d05618cfe92594 not found: ID does not exist" Jul 21 15:05:34.842123 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842057 2585 scope.go:117] "RemoveContainer" containerID="a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047" Jul 21 15:05:34.842283 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842260 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047"} err="failed to get container status \"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047\": rpc error: code = NotFound desc = could not find container \"a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047\": container with ID starting with a7f1f0a8ac7730a6f17cf9ad566f8963b43ca0bf3709e5b8adada74c7b860047 not found: ID does not exist" Jul 21 15:05:34.842353 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842283 2585 scope.go:117] "RemoveContainer" containerID="170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660" Jul 21 15:05:34.842530 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842512 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660"} err="failed to get container status \"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660\": rpc error: code = NotFound desc = could not find container \"170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660\": container with ID starting with 170efd3b515d5b133d9c65e1ca0e903e8e5962e01abc6e876119e034c2042660 not found: ID does not exist" Jul 21 15:05:34.842574 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842530 2585 scope.go:117] "RemoveContainer" containerID="80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7" Jul 21 15:05:34.842753 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842737 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7"} err="failed to get container status \"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7\": rpc error: code = NotFound desc = could not find container \"80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7\": container with ID starting with 80c34c1562e2c74be48a1cb77e4ec5ec8c3a862e8c5e281583c73e2dfe3abdc7 not found: ID does not exist" Jul 21 15:05:34.842753 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842752 2585 scope.go:117] "RemoveContainer" containerID="21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d" Jul 21 15:05:34.842961 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.842945 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d"} err="failed to get container status \"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d\": rpc error: code = NotFound desc = could not find container \"21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d\": container with ID starting with 21e38439596b0305002d1207042e525086b5fde8cf6a57a951469c0b1cdf214d not found: ID does not exist" Jul 21 15:05:34.846822 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.846804 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:34.847045 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847034 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="alertmanager" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847047 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="alertmanager" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847054 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="init-config-reloader" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847059 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="init-config-reloader" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847069 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-metric" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847074 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-metric" Jul 21 15:05:34.847082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847081 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="config-reloader" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847088 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="config-reloader" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847097 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-web" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847102 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-web" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847109 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847114 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847119 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="prom-label-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847126 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="prom-label-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847207 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="alertmanager" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847215 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-web" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847222 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="config-reloader" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847227 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="prom-label-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847234 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy" Jul 21 15:05:34.847271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.847239 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" containerName="kube-rbac-proxy-metric" Jul 21 15:05:34.851803 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.851788 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.854381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854361 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2vkf7\"" Jul 21 15:05:34.854381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854364 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 15:05:34.854544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854395 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 15:05:34.854544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854369 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 15:05:34.854670 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854654 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 15:05:34.854944 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854932 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 15:05:34.854999 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.854962 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 15:05:34.855142 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.855130 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 15:05:34.855206 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.855183 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 15:05:34.865116 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.865091 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 15:05:34.866560 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.866539 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:34.954360 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954323 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcd8w\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-kube-api-access-hcd8w\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954370 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954397 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954464 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954520 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954554 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954584 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954614 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954664 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954677 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954710 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:34.954733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:34.954727 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055395 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055442 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055467 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055744 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055518 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcd8w\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-kube-api-access-hcd8w\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055744 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055744 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055574 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055744 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055744 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055633 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.055988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.055969 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.056109 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.056082 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.056381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.056117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.056381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.056168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.056381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.056284 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.057007 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.056979 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.057801 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.057778 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ecea86-8251-464e-9355-4682ef5c5d1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.058814 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.058789 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.058914 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.058888 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.059080 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.059049 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.059197 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.059094 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.059300 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.059279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.059407 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.059387 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.059448 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.059408 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.060770 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.060755 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.061101 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.061080 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ecea86-8251-464e-9355-4682ef5c5d1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.069543 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.069519 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcd8w\" (UniqueName: \"kubernetes.io/projected/c8ecea86-8251-464e-9355-4682ef5c5d1d-kube-api-access-hcd8w\") pod \"alertmanager-main-0\" (UID: \"c8ecea86-8251-464e-9355-4682ef5c5d1d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.166781 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.166745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 15:05:35.316256 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.316088 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 15:05:35.318762 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:05:35.318741 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ecea86_8251_464e_9355_4682ef5c5d1d.slice/crio-7fdaa4151c27aa689a148f039ff169bbd89ba765df1a0a5ae3d56ca071b9470b WatchSource:0}: Error finding container 7fdaa4151c27aa689a148f039ff169bbd89ba765df1a0a5ae3d56ca071b9470b: Status 404 returned error can't find the container with id 7fdaa4151c27aa689a148f039ff169bbd89ba765df1a0a5ae3d56ca071b9470b Jul 21 15:05:35.553431 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.553399 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8183ac0-776a-4b15-8575-cb8e47766869" path="/var/lib/kubelet/pods/d8183ac0-776a-4b15-8575-cb8e47766869/volumes" Jul 21 15:05:35.796252 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.796219 2585 generic.go:356] "Generic (PLEG): container finished" podID="c8ecea86-8251-464e-9355-4682ef5c5d1d" containerID="7bba3035d9edc24cdd2a771233094db12110256769d5e3a3b919200ca1a314fe" exitCode=0 Jul 21 15:05:35.796639 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.796264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerDied","Data":"7bba3035d9edc24cdd2a771233094db12110256769d5e3a3b919200ca1a314fe"} Jul 21 15:05:35.796639 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:35.796354 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"7fdaa4151c27aa689a148f039ff169bbd89ba765df1a0a5ae3d56ca071b9470b"} Jul 21 15:05:36.702688 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.702654 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68f785c84f-2lrml"] Jul 21 15:05:36.705884 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.705869 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.708375 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708354 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gd78h\"" Jul 21 15:05:36.708375 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708363 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 15:05:36.708375 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708373 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 15:05:36.708600 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708424 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 15:05:36.708600 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708440 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 15:05:36.708725 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.708710 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 15:05:36.713773 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.713754 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 15:05:36.720021 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.719976 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68f785c84f-2lrml"] Jul 21 15:05:36.802686 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802649 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"c90d2e13b24dc118f76e064faa301f3553c1c3a55eb49fd8f0622588adc34f8f"} Jul 21 15:05:36.803038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802706 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"d6741eca62adf81fc1d1245dc58bd12dfc1a0c7a96dafcde99c199f3af966b2f"} Jul 21 15:05:36.803038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802731 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"aeabfb951d3a79d46066f0b8a32891592b3484a4ca999408d07b70948f4ec739"} Jul 21 15:05:36.803038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802755 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"b0de2a048da1b175cead91029127937160d2b4e2dcaf8903613771c2db5b837c"} Jul 21 15:05:36.803038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"7be7f910e24064c2da0c90587ab6bc16411e24b01db7dcd2ac681a0a9938bf7b"} Jul 21 15:05:36.803038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.802815 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ecea86-8251-464e-9355-4682ef5c5d1d","Type":"ContainerStarted","Data":"f72b9f77c6eb57004f5b90b3b23df3be05ebad39ddc68d994c627f3c3b13e0eb"} Jul 21 15:05:36.833179 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.833114 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8182237519999997 podStartE2EDuration="2.833098475s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.874723ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:05:36.831638439 +0000 UTC m=+359.833892827" watchObservedRunningTime="2026-07-21 15:05:36.833098475 +0000 UTC m=+359.835352862" Jul 21 15:05:36.872052 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-federate-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872192 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872060 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872192 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgbx\" (UniqueName: \"kubernetes.io/projected/a6cda195-0811-4443-9d12-db50e75f8b69-kube-api-access-zxgbx\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872192 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872172 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-serving-certs-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872249 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.872398 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.872311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-metrics-client-ca\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973076 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.972998 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973076 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgbx\" (UniqueName: \"kubernetes.io/projected/a6cda195-0811-4443-9d12-db50e75f8b69-kube-api-access-zxgbx\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973329 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973075 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-serving-certs-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973541 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973488 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973541 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973522 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973642 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973563 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-metrics-client-ca\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.973694 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.973638 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-federate-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.974085 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.974057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.974286 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.974262 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-metrics-client-ca\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.974364 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.974105 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cda195-0811-4443-9d12-db50e75f8b69-serving-certs-ca-bundle\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.976237 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.976210 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-telemeter-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.976348 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.976285 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.976440 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.976419 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-federate-client-tls\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.976651 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.976632 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6cda195-0811-4443-9d12-db50e75f8b69-secret-telemeter-client\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:36.982898 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:36.982874 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgbx\" (UniqueName: \"kubernetes.io/projected/a6cda195-0811-4443-9d12-db50e75f8b69-kube-api-access-zxgbx\") pod \"telemeter-client-68f785c84f-2lrml\" (UID: \"a6cda195-0811-4443-9d12-db50e75f8b69\") " pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:37.014841 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:37.014818 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" Jul 21 15:05:37.152647 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:37.152609 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68f785c84f-2lrml"] Jul 21 15:05:37.155639 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:05:37.155614 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cda195_0811_4443_9d12_db50e75f8b69.slice/crio-cad4f2ab70860d20a38895c5a77bb546c26b7939beb72cce39b64d4e85047380 WatchSource:0}: Error finding container cad4f2ab70860d20a38895c5a77bb546c26b7939beb72cce39b64d4e85047380: Status 404 returned error can't find the container with id cad4f2ab70860d20a38895c5a77bb546c26b7939beb72cce39b64d4e85047380 Jul 21 15:05:37.157627 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:37.157611 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:05:37.807264 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:37.807184 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" event={"ID":"a6cda195-0811-4443-9d12-db50e75f8b69","Type":"ContainerStarted","Data":"cad4f2ab70860d20a38895c5a77bb546c26b7939beb72cce39b64d4e85047380"} Jul 21 15:05:41.824885 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:41.824845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" event={"ID":"a6cda195-0811-4443-9d12-db50e75f8b69","Type":"ContainerStarted","Data":"1f788b3e134cfe9a447e0cbf51684ec9dc9b31a5c188185fb450ddfdad461344"} Jul 21 15:05:41.825366 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:41.824900 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" event={"ID":"a6cda195-0811-4443-9d12-db50e75f8b69","Type":"ContainerStarted","Data":"2caca35157bcc2362101c89c94313701c7c620b6f0f9d5a7e36f10ffd533039c"} Jul 21 15:05:41.825366 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:41.824920 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" event={"ID":"a6cda195-0811-4443-9d12-db50e75f8b69","Type":"ContainerStarted","Data":"02deecb796b4831660f61cdd85d86e733d50f7b75735cfdc25ee911d0a03b727"} Jul 21 15:05:41.849486 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:41.849429 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68f785c84f-2lrml" podStartSLOduration=2.151871349 podStartE2EDuration="5.849414063s" totalImagesPullingTime="3.697542714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:05:41.848112999 +0000 UTC m=+364.850367385" watchObservedRunningTime="2026-07-21 15:05:41.849414063 +0000 UTC m=+364.851668459" Jul 21 15:05:42.640866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:42.640836 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:42.741501 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:42.741468 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:43.879381 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:43.879351 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:43.949204 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:43.949171 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:53.985051 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:53.985014 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:54.086158 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:54.086124 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:05:54.214634 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:05:54.214600 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:36.344373 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:36.344337 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:36.475611 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:36.475568 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:46.984119 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:46.984091 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:47.489495 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:47.489439 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:53.782297 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:53.782257 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:54.855448 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:54.855417 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:58.825511 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:58.825441 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:06:58.899940 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:06:58.899909 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:03.467453 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:03.467424 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:03.520592 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:03.520565 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:04.037947 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:04.037914 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:04.218007 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:04.217974 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:04.305415 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:04.305339 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:04.366243 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:04.366217 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:05.011522 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:05.011491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:05.116658 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:05.116618 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:46.774015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.773982 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:46.809907 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.809881 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc"] Jul 21 15:07:46.812927 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.812910 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.815511 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.815492 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 15:07:46.816541 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.816518 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 21 15:07:46.816615 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.816586 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 15:07:46.816786 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.816769 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 15:07:46.822139 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.822120 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc"] Jul 21 15:07:46.825052 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.825028 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dab5700c-faa8-4936-9dd3-773c31e5d6c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.825159 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.825094 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28zf2\" (UniqueName: \"kubernetes.io/projected/dab5700c-faa8-4936-9dd3-773c31e5d6c9-kube-api-access-28zf2\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.825159 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.825124 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dab5700c-faa8-4936-9dd3-773c31e5d6c9-tmp\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.845383 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.845356 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:46.862773 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.862745 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb"] Jul 21 15:07:46.865892 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.865877 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.868590 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.868569 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 21 15:07:46.868687 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.868677 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 21 15:07:46.868752 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.868715 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 21 15:07:46.868752 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.868677 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 21 15:07:46.878159 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.878125 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb"] Jul 21 15:07:46.925654 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925778 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925659 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925778 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925684 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqs5f\" (UniqueName: \"kubernetes.io/projected/5a7130bf-5147-4a57-a836-44ce0d0648c4-kube-api-access-rqs5f\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925778 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925742 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28zf2\" (UniqueName: \"kubernetes.io/projected/dab5700c-faa8-4936-9dd3-773c31e5d6c9-kube-api-access-28zf2\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.925778 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925769 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925786 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7130bf-5147-4a57-a836-44ce0d0648c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925813 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dab5700c-faa8-4936-9dd3-773c31e5d6c9-tmp\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.925962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925881 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:46.925962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.925929 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dab5700c-faa8-4936-9dd3-773c31e5d6c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.926181 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.926059 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dab5700c-faa8-4936-9dd3-773c31e5d6c9-tmp\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.928508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.928486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dab5700c-faa8-4936-9dd3-773c31e5d6c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:46.933492 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:46.933469 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28zf2\" (UniqueName: \"kubernetes.io/projected/dab5700c-faa8-4936-9dd3-773c31e5d6c9-kube-api-access-28zf2\") pod \"klusterlet-addon-workmgr-59f9f4cc59-74jkc\" (UID: \"dab5700c-faa8-4936-9dd3-773c31e5d6c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:47.026527 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.026527 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.026755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.026755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026558 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqs5f\" (UniqueName: \"kubernetes.io/projected/5a7130bf-5147-4a57-a836-44ce0d0648c4-kube-api-access-rqs5f\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.026755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026592 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.026755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.026725 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7130bf-5147-4a57-a836-44ce0d0648c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.027413 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.027329 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7130bf-5147-4a57-a836-44ce0d0648c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.029276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.029257 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.029363 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.029294 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.029527 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.029511 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-ca\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.029638 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.029619 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a7130bf-5147-4a57-a836-44ce0d0648c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.036648 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.036626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqs5f\" (UniqueName: \"kubernetes.io/projected/5a7130bf-5147-4a57-a836-44ce0d0648c4-kube-api-access-rqs5f\") pod \"cluster-proxy-proxy-agent-8b955db56-bk2mb\" (UID: \"5a7130bf-5147-4a57-a836-44ce0d0648c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.121926 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.121900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:47.186288 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.186135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" Jul 21 15:07:47.258118 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.258078 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc"] Jul 21 15:07:47.260406 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:07:47.260377 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab5700c_faa8_4936_9dd3_773c31e5d6c9.slice/crio-cc416c7f88d90fd946b0ffe8c89ffe9c3135f5491663cc4f4205d5dac1c3c325 WatchSource:0}: Error finding container cc416c7f88d90fd946b0ffe8c89ffe9c3135f5491663cc4f4205d5dac1c3c325: Status 404 returned error can't find the container with id cc416c7f88d90fd946b0ffe8c89ffe9c3135f5491663cc4f4205d5dac1c3c325 Jul 21 15:07:47.300639 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.300559 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" event={"ID":"dab5700c-faa8-4936-9dd3-773c31e5d6c9","Type":"ContainerStarted","Data":"cc416c7f88d90fd946b0ffe8c89ffe9c3135f5491663cc4f4205d5dac1c3c325"} Jul 21 15:07:47.319584 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:47.319563 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb"] Jul 21 15:07:47.321483 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:07:47.321459 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a7130bf_5147_4a57_a836_44ce0d0648c4.slice/crio-4ce1b6b15e9d05aac67dd713bc87e93493a6eff5eea0b413113bb2d10d97f07b WatchSource:0}: Error finding container 4ce1b6b15e9d05aac67dd713bc87e93493a6eff5eea0b413113bb2d10d97f07b: Status 404 returned error can't find the container with id 4ce1b6b15e9d05aac67dd713bc87e93493a6eff5eea0b413113bb2d10d97f07b Jul 21 15:07:48.308738 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:48.308697 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" event={"ID":"5a7130bf-5147-4a57-a836-44ce0d0648c4","Type":"ContainerStarted","Data":"4ce1b6b15e9d05aac67dd713bc87e93493a6eff5eea0b413113bb2d10d97f07b"} Jul 21 15:07:49.629491 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:49.629446 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:49.730701 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:49.730671 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:51.956136 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:51.956106 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:07:52.332322 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:52.332232 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" event={"ID":"dab5700c-faa8-4936-9dd3-773c31e5d6c9","Type":"ContainerStarted","Data":"e566ad0d3eba4ced0bc43dfe8fb18109a4625d79ee90648597293be0cf4bc897"} Jul 21 15:07:52.332500 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:52.332387 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:52.334441 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:52.334418 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" Jul 21 15:07:52.348616 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:52.348568 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f9f4cc59-74jkc" podStartSLOduration=2.312287392 podStartE2EDuration="6.348552238s" totalImagesPullingTime="4.036264846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:07:52.348332483 +0000 UTC m=+495.350586871" watchObservedRunningTime="2026-07-21 15:07:52.348552238 +0000 UTC m=+495.350806639" Jul 21 15:07:53.338598 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:53.338500 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" event={"ID":"5a7130bf-5147-4a57-a836-44ce0d0648c4","Type":"ContainerStarted","Data":"a4c7d57f883e78bc4a941727499dbe8da8daf2d7cd0a7425c950549857daf761"} Jul 21 15:07:53.338598 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:53.338557 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" event={"ID":"5a7130bf-5147-4a57-a836-44ce0d0648c4","Type":"ContainerStarted","Data":"78e0e085f40fc9eafe037156a8bfa78a82971cada2e5bffe2b29fb8682cb1207"} Jul 21 15:07:53.338598 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:53.338574 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" event={"ID":"5a7130bf-5147-4a57-a836-44ce0d0648c4","Type":"ContainerStarted","Data":"750d8619efa4259a0c82a87cbe090a0500d57d0ebf10d333dceaadf822e8d663"} Jul 21 15:07:53.356371 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:07:53.356310 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8b955db56-bk2mb" podStartSLOduration=1.742956371 podStartE2EDuration="7.356293459s" totalImagesPullingTime="5.613337088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:07:53.355514889 +0000 UTC m=+496.357769278" watchObservedRunningTime="2026-07-21 15:07:53.356293459 +0000 UTC m=+496.358547861" Jul 21 15:08:07.889943 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:07.889912 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:47.814322 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:47.814282 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:48.527504 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:48.527471 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:51.322812 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:51.322781 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:51.429475 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:51.429446 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:56.134044 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:56.134004 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:08:56.214548 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:08:56.214519 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:09.986638 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:09.986604 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:12.479164 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:12.479117 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:12.872315 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:12.872287 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:19.849693 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:19.849658 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:20.261824 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:20.261733 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:20.749914 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:20.749884 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:22.081828 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:22.081792 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:22.186992 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:22.186958 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:26.109956 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:26.109922 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:26.209920 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:26.209893 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:27.861349 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:27.861315 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:37.422131 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:37.422107 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:09:37.424956 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:37.424935 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:09:40.228954 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:40.228917 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:40.404529 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:40.404491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:41.030259 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.030224 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:41.267644 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.267609 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:41.409775 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.409741 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq"] Jul 21 15:09:41.412307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.412287 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.415182 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.415141 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 15:09:41.415297 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.415259 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 15:09:41.415363 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.415269 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 15:09:41.415442 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.415420 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2sbsb\"" Jul 21 15:09:41.415570 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.415512 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 15:09:41.432017 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.431993 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq"] Jul 21 15:09:41.465828 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.465795 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.465993 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.465838 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.465993 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.465923 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7d45\" (UniqueName: \"kubernetes.io/projected/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-kube-api-access-n7d45\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.465993 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.465964 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.466124 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.465999 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.566443 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.566402 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7d45\" (UniqueName: \"kubernetes.io/projected/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-kube-api-access-n7d45\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.566443 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.566454 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.566692 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.566482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.566692 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.566517 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.566692 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.566611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.567034 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.567014 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.569052 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.569023 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.569206 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.569096 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.569206 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.569131 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.580105 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.580084 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7d45\" (UniqueName: \"kubernetes.io/projected/98314bc1-f739-40ec-ba41-3cd4e7dd2fa7-kube-api-access-n7d45\") pod \"opendatahub-operator-controller-manager-85b74964cc-jrhxq\" (UID: \"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.722897 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.722801 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:41.785182 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.785110 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:41.865525 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.865501 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq"] Jul 21 15:09:41.867662 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:09:41.867638 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98314bc1_f739_40ec_ba41_3cd4e7dd2fa7.slice/crio-696f4dca80663b3c3aaa782923ed75c68c10a20c08c8d7bbc8034bfd1b590f2a WatchSource:0}: Error finding container 696f4dca80663b3c3aaa782923ed75c68c10a20c08c8d7bbc8034bfd1b590f2a: Status 404 returned error can't find the container with id 696f4dca80663b3c3aaa782923ed75c68c10a20c08c8d7bbc8034bfd1b590f2a Jul 21 15:09:41.872180 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.872161 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:41.944569 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:41.944539 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:42.044626 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:42.044549 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:42.156110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:42.156082 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:42.748922 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:42.748875 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" event={"ID":"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7","Type":"ContainerStarted","Data":"696f4dca80663b3c3aaa782923ed75c68c10a20c08c8d7bbc8034bfd1b590f2a"} Jul 21 15:09:45.765720 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:45.765691 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" event={"ID":"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7","Type":"ContainerStarted","Data":"3c9cc18110380d2fa8191d03bb437b90b034e1a1f1410c0346fe18bdacd6b262"} Jul 21 15:09:46.771604 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:46.771570 2585 generic.go:356] "Generic (PLEG): container finished" podID="98314bc1-f739-40ec-ba41-3cd4e7dd2fa7" containerID="3c9cc18110380d2fa8191d03bb437b90b034e1a1f1410c0346fe18bdacd6b262" exitCode=0 Jul 21 15:09:46.771604 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:46.771608 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" event={"ID":"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7","Type":"ContainerDied","Data":"3c9cc18110380d2fa8191d03bb437b90b034e1a1f1410c0346fe18bdacd6b262"} Jul 21 15:09:47.777428 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:47.777392 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" event={"ID":"98314bc1-f739-40ec-ba41-3cd4e7dd2fa7","Type":"ContainerStarted","Data":"9fee3fc80865dd1b63a97b199bdf6839780c0795d1c8d402d7c1e8fd21ee0b34"} Jul 21 15:09:47.777820 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:47.777615 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:09:47.805331 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:47.805281 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" podStartSLOduration=2.440266274 podStartE2EDuration="6.805263838s" totalImagesPullingTime="3.356798123s" totalInitContainerRuntime="1.008199441s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:47.80308209 +0000 UTC m=+610.805336480" watchObservedRunningTime="2026-07-21 15:09:47.805263838 +0000 UTC m=+610.807518227" Jul 21 15:09:50.104912 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:50.104877 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:50.205301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:50.205260 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:56.345028 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:56.344991 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:09:58.784307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:09:58.784238 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-jrhxq" Jul 21 15:10:00.713710 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.713672 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd"] Jul 21 15:10:00.716892 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.716876 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.720621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.720597 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zdfng\"" Jul 21 15:10:00.720776 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.720600 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 15:10:00.720776 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.720722 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:10:00.720895 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.720803 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 15:10:00.720895 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.720873 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 15:10:00.721097 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.721081 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 15:10:00.729877 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.729855 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd"] Jul 21 15:10:00.825865 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.825825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.825865 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.825866 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8dce6e-b44e-49d3-a09d-867f308d2035-manager-config\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.826111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.825891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvk8\" (UniqueName: \"kubernetes.io/projected/dd8dce6e-b44e-49d3-a09d-867f308d2035-kube-api-access-ljvk8\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.826111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.826014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.927125 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.927090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvk8\" (UniqueName: \"kubernetes.io/projected/dd8dce6e-b44e-49d3-a09d-867f308d2035-kube-api-access-ljvk8\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.927347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.927187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.927347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.927248 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.927347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.927281 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8dce6e-b44e-49d3-a09d-867f308d2035-manager-config\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.928026 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.927952 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8dce6e-b44e-49d3-a09d-867f308d2035-manager-config\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.929894 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.929873 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.929984 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.929899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8dce6e-b44e-49d3-a09d-867f308d2035-cert\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:00.943751 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:00.943725 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvk8\" (UniqueName: \"kubernetes.io/projected/dd8dce6e-b44e-49d3-a09d-867f308d2035-kube-api-access-ljvk8\") pod \"lws-controller-manager-c4b7cdb88-942vd\" (UID: \"dd8dce6e-b44e-49d3-a09d-867f308d2035\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:01.025836 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.025751 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:01.170856 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.170828 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd"] Jul 21 15:10:01.173557 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:10:01.173524 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8dce6e_b44e_49d3_a09d_867f308d2035.slice/crio-35d640474f32f83619d7634f8f2fbf260997af53f3cf8e77bdacca96d6adf974 WatchSource:0}: Error finding container 35d640474f32f83619d7634f8f2fbf260997af53f3cf8e77bdacca96d6adf974: Status 404 returned error can't find the container with id 35d640474f32f83619d7634f8f2fbf260997af53f3cf8e77bdacca96d6adf974 Jul 21 15:10:01.345647 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.345568 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:01.480454 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.480418 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:01.838362 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.838316 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" event={"ID":"dd8dce6e-b44e-49d3-a09d-867f308d2035","Type":"ContainerStarted","Data":"35d640474f32f83619d7634f8f2fbf260997af53f3cf8e77bdacca96d6adf974"} Jul 21 15:10:01.885706 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:01.885668 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:02.222272 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:02.222070 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:02.318691 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:02.318607 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:02.416392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:02.416294 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:03.304069 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.304036 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k8g75"] Jul 21 15:10:03.313382 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.313353 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.321491 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.321458 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5j9zc\"" Jul 21 15:10:03.321648 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.321524 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 21 15:10:03.341917 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.339319 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k8g75"] Jul 21 15:10:03.351555 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.351524 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:03.451645 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.451593 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrpl\" (UniqueName: \"kubernetes.io/projected/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-kube-api-access-jtrpl\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.451823 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.451669 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.457485 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.457419 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:03.527606 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.527572 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:03.552348 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.552310 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrpl\" (UniqueName: \"kubernetes.io/projected/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-kube-api-access-jtrpl\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.552514 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.552379 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.555021 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.554958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.560893 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.560857 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrpl\" (UniqueName: \"kubernetes.io/projected/5df1c63f-4331-4939-a3a9-87fe64f4c8f4-kube-api-access-jtrpl\") pod \"model-serving-api-54d89bd5fc-k8g75\" (UID: \"5df1c63f-4331-4939-a3a9-87fe64f4c8f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:03.628601 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:03.628568 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:04.067065 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.067036 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k8g75"] Jul 21 15:10:04.069493 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:10:04.069471 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df1c63f_4331_4939_a3a9_87fe64f4c8f4.slice/crio-f9b34d50e6092cef12ecb75794bdea28cc06b6d429c79588653630dc8cbec57e WatchSource:0}: Error finding container f9b34d50e6092cef12ecb75794bdea28cc06b6d429c79588653630dc8cbec57e: Status 404 returned error can't find the container with id f9b34d50e6092cef12ecb75794bdea28cc06b6d429c79588653630dc8cbec57e Jul 21 15:10:04.532779 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.532739 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:04.854765 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.854731 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" event={"ID":"dd8dce6e-b44e-49d3-a09d-867f308d2035","Type":"ContainerStarted","Data":"ed773bb577fd8113c1e6e03a3a58c8d1cb252dce2231e937ef10ac404610e39e"} Jul 21 15:10:04.854965 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.854839 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:04.855978 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.855957 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" event={"ID":"5df1c63f-4331-4939-a3a9-87fe64f4c8f4","Type":"ContainerStarted","Data":"f9b34d50e6092cef12ecb75794bdea28cc06b6d429c79588653630dc8cbec57e"} Jul 21 15:10:04.873518 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:04.873475 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" podStartSLOduration=2.053055566 podStartE2EDuration="4.873460079s" totalImagesPullingTime="2.820404513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:04.871836059 +0000 UTC m=+627.874090458" watchObservedRunningTime="2026-07-21 15:10:04.873460079 +0000 UTC m=+627.875714465" Jul 21 15:10:06.867133 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:06.867097 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" event={"ID":"5df1c63f-4331-4939-a3a9-87fe64f4c8f4","Type":"ContainerStarted","Data":"f276a5cf62528ae22f0fba90fa54fa840f28d1d516611e941a95b28027acb696"} Jul 21 15:10:06.867517 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:06.867318 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:06.889489 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:06.889445 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" podStartSLOduration=1.448532623 podStartE2EDuration="3.889428648s" totalImagesPullingTime="2.440896025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:06.887938112 +0000 UTC m=+629.890192500" watchObservedRunningTime="2026-07-21 15:10:06.889428648 +0000 UTC m=+629.891683034" Jul 21 15:10:07.191087 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:07.191009 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:08.238455 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:08.238418 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:08.302685 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:08.302653 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:08.968347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:08.968314 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:09.193338 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:09.193310 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:09.348296 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:09.348269 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:10.933561 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.933526 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr"] Jul 21 15:10:10.936831 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.936812 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:10.939543 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939521 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 21 15:10:10.939680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939565 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 15:10:10.939680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939530 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 21 15:10:10.939680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939527 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 21 15:10:10.939838 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939679 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c2lcg\"" Jul 21 15:10:10.939904 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939889 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 15:10:10.939937 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.939894 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 15:10:10.948840 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:10.948818 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr"] Jul 21 15:10:11.022402 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022414 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022493 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsd2t\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-kube-api-access-wsd2t\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022549 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.022767 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.022638 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123277 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123277 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123282 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123522 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123522 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123549 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123619 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.123721 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.123632 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsd2t\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-kube-api-access-wsd2t\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.124190 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.124095 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.125762 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.125741 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.125981 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.125964 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.126347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.126326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.126445 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.126427 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.132453 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.132428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.132729 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.132709 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsd2t\" (UniqueName: \"kubernetes.io/projected/c9b41a84-a5fa-41db-b4c6-3f1f4834ddff-kube-api-access-wsd2t\") pod \"istiod-openshift-gateway-94bb8fbfd-6rjzr\" (UID: \"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.246371 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.246289 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:11.422055 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.422031 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr"] Jul 21 15:10:11.424085 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:10:11.424060 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b41a84_a5fa_41db_b4c6_3f1f4834ddff.slice/crio-7d1236dcc019e4c5ab356cb514db2982b336756333097813a6efc2b48d4808eb WatchSource:0}: Error finding container 7d1236dcc019e4c5ab356cb514db2982b336756333097813a6efc2b48d4808eb: Status 404 returned error can't find the container with id 7d1236dcc019e4c5ab356cb514db2982b336756333097813a6efc2b48d4808eb Jul 21 15:10:11.891004 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:11.890970 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" event={"ID":"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff","Type":"ContainerStarted","Data":"7d1236dcc019e4c5ab356cb514db2982b336756333097813a6efc2b48d4808eb"} Jul 21 15:10:12.793636 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:12.793570 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:12.896014 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:12.895978 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:13.074713 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:13.074582 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:13.266507 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:13.266471 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:13.416618 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:13.416587 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:14.004226 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:14.004185 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 21 15:10:14.004595 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:14.004269 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 21 15:10:14.908066 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:14.908034 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" event={"ID":"c9b41a84-a5fa-41db-b4c6-3f1f4834ddff","Type":"ContainerStarted","Data":"c16946d2142e5125e936cdf76f8a71e3406ced523b493119d0455d7c3be512ee"} Jul 21 15:10:14.908279 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:14.908093 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:14.931211 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:14.931159 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" podStartSLOduration=2.35367207 podStartE2EDuration="4.931127892s" totalImagesPullingTime="2.577455822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:14.928683647 +0000 UTC m=+637.930938069" watchObservedRunningTime="2026-07-21 15:10:14.931127892 +0000 UTC m=+637.933382281" Jul 21 15:10:15.863456 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:15.863428 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-942vd" Jul 21 15:10:15.914581 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:15.914553 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6rjzr" Jul 21 15:10:16.368344 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:16.368314 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:16.446536 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:16.446506 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:17.875309 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:17.875285 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-k8g75" Jul 21 15:10:46.357165 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:46.357129 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:46.458296 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:46.458252 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:46.996550 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:46.996505 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:57.260291 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:57.260256 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:57.376569 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:57.376523 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:10:57.483826 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:10:57.483790 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:03.137354 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:03.137304 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:03.266587 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:03.266553 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:10.443305 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:10.443265 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:12.184097 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:12.184054 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:12.285531 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:12.285499 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:17.411083 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:17.411046 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:19.824262 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:19.824230 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:20.303519 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:20.303481 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:21.995589 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:21.995555 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:22.094854 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:22.094819 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:25.354975 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:25.354938 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:25.459680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:25.459647 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:27.204989 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:27.204954 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:29.132968 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:29.132929 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:30.237013 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:30.236976 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:30.340413 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:30.340381 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:34.226072 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:34.226039 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:34.325642 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:34.325610 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:34.616480 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:34.616449 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:34.725015 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:34.724984 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:37.608054 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:37.608021 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:37.979248 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:37.979141 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:38.637231 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:38.637196 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:38.752654 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:38.752620 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:38.861409 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:38.861361 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:45.170834 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:45.170795 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:45.266980 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:45.266945 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:49.650712 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:49.650672 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:49.750901 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:49.750858 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:52.954127 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:52.954092 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:55.268966 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:55.268933 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:55.367974 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:55.367940 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:57.811074 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:57.811038 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:57.906630 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:57.906596 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:11:58.004533 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:11:58.004496 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:04.246416 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:04.246381 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:04.313630 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:04.313590 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:08.602960 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:08.602927 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:08.701428 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:08.701391 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:10.014003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:10.013958 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:12.415693 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:12.415658 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:12.485706 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:12.485672 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:12.597965 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:12.597927 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:12.766132 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:12.766050 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:18.078789 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:18.078757 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:18.181425 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:18.181385 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:18.279449 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:18.279422 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:18.859719 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:18.859686 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:18.964024 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:18.963992 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:21.581507 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:21.581471 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:22.035848 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:22.035811 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:24.322109 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:24.322064 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:24.395760 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:24.395731 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:37.051395 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:37.051361 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:37.150592 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:37.150559 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:37.251851 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:37.251816 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:37.891118 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:37.891087 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:37.974544 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:37.974505 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:55.204806 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:55.204770 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:55.746383 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:55.746351 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:12:55.805085 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:12:55.805056 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:08.730518 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:08.730430 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:09.042538 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:09.042455 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:18.098866 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:18.098833 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:18.197957 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:18.197920 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:18.299898 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:18.299870 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:18.410321 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:18.410230 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:22.301541 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:22.301504 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:22.412368 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:22.412330 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:26.294510 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:26.294478 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:54.260600 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:54.260562 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:54.424455 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:54.424388 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:54.824809 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:54.824764 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:55.205029 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:55.204996 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:55.428412 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:55.428381 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:13:55.522905 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:13:55.522813 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:07.497594 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:07.497554 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:07.721211 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:07.721173 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:21.688566 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:21.688528 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:25.558898 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.558861 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn"] Jul 21 15:14:25.561278 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.561258 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.567433 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.567408 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wcwjp\"" Jul 21 15:14:25.568368 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.568351 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 15:14:25.568505 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.568485 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 15:14:25.568505 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.568501 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 21 15:14:25.576170 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.576047 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn"] Jul 21 15:14:25.663643 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.663800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663649 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.663800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663677 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.663800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663761 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxq96\" (UniqueName: \"kubernetes.io/projected/63c693ed-6bc9-4e51-91f9-0a506ab6f600-kube-api-access-sxq96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.663800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.663930 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.663833 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765031 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.764995 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxq96\" (UniqueName: \"kubernetes.io/projected/63c693ed-6bc9-4e51-91f9-0a506ab6f600-kube-api-access-sxq96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765227 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765037 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765227 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765188 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765311 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765268 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765350 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765310 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765350 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765336 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765613 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765593 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765676 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765614 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.765809 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.765766 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.767549 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.767526 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c693ed-6bc9-4e51-91f9-0a506ab6f600-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.767658 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.767643 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c693ed-6bc9-4e51-91f9-0a506ab6f600-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.784748 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.784711 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxq96\" (UniqueName: \"kubernetes.io/projected/63c693ed-6bc9-4e51-91f9-0a506ab6f600-kube-api-access-sxq96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bgcnn\" (UID: \"63c693ed-6bc9-4e51-91f9-0a506ab6f600\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:25.892725 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:25.892694 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:26.029003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:26.028971 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn"] Jul 21 15:14:26.032490 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:14:26.032463 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c693ed_6bc9_4e51_91f9_0a506ab6f600.slice/crio-bccc507cec0ae4127af20f1e9652a2a10a003efbbceae96fefc67ef1eabd878f WatchSource:0}: Error finding container bccc507cec0ae4127af20f1e9652a2a10a003efbbceae96fefc67ef1eabd878f: Status 404 returned error can't find the container with id bccc507cec0ae4127af20f1e9652a2a10a003efbbceae96fefc67ef1eabd878f Jul 21 15:14:26.033747 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:26.033725 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:14:27.004213 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:27.004177 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" event={"ID":"63c693ed-6bc9-4e51-91f9-0a506ab6f600","Type":"ContainerStarted","Data":"bccc507cec0ae4127af20f1e9652a2a10a003efbbceae96fefc67ef1eabd878f"} Jul 21 15:14:28.010968 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:28.010888 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" event={"ID":"63c693ed-6bc9-4e51-91f9-0a506ab6f600","Type":"ContainerStarted","Data":"37f84f85544bb7d6740d4c6e562ef431d7425d9558d2d618a9a5d6d94f4904d0"} Jul 21 15:14:28.030376 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:28.030314 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" podStartSLOduration=1.991264813 podStartE2EDuration="3.030297714s" totalImagesPullingTime="1.039032901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:14:28.028246669 +0000 UTC m=+891.030501057" watchObservedRunningTime="2026-07-21 15:14:28.030297714 +0000 UTC m=+891.032552101" Jul 21 15:14:30.775354 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:30.775321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:35.893006 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:35.892968 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:35.893528 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:35.893043 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:35.905753 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:35.905723 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:36.055781 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:36.055752 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bgcnn" Jul 21 15:14:37.453745 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.453711 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:14:37.458241 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.458223 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:14:37.542028 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.541998 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr"] Jul 21 15:14:37.550134 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.550113 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.552707 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.552680 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 15:14:37.556937 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.556914 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr"] Jul 21 15:14:37.572451 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.572429 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:37.674703 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674658 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.674848 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674711 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.674848 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.674848 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674824 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.675022 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674852 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08903c86-d49c-40df-94e5-1205f3521926-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.675022 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.674926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mbs\" (UniqueName: \"kubernetes.io/projected/08903c86-d49c-40df-94e5-1205f3521926-kube-api-access-j6mbs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775679 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775679 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775633 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775679 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775959 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775959 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775708 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08903c86-d49c-40df-94e5-1205f3521926-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.775959 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.775732 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mbs\" (UniqueName: \"kubernetes.io/projected/08903c86-d49c-40df-94e5-1205f3521926-kube-api-access-j6mbs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.776108 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.776054 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.776108 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.776063 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.776217 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.776166 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.778142 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.778119 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08903c86-d49c-40df-94e5-1205f3521926-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.778244 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.778234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08903c86-d49c-40df-94e5-1205f3521926-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.783764 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.783744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mbs\" (UniqueName: \"kubernetes.io/projected/08903c86-d49c-40df-94e5-1205f3521926-kube-api-access-j6mbs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-68hwr\" (UID: \"08903c86-d49c-40df-94e5-1205f3521926\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.861931 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.861905 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:37.991752 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:37.991696 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr"] Jul 21 15:14:37.994319 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:14:37.994297 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08903c86_d49c_40df_94e5_1205f3521926.slice/crio-b2c9c7e5542d73cac87f9696fed433bf279204ba5727ffade07e54f36e484b61 WatchSource:0}: Error finding container b2c9c7e5542d73cac87f9696fed433bf279204ba5727ffade07e54f36e484b61: Status 404 returned error can't find the container with id b2c9c7e5542d73cac87f9696fed433bf279204ba5727ffade07e54f36e484b61 Jul 21 15:14:38.054536 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:38.054466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" event={"ID":"08903c86-d49c-40df-94e5-1205f3521926","Type":"ContainerStarted","Data":"b2c9c7e5542d73cac87f9696fed433bf279204ba5727ffade07e54f36e484b61"} Jul 21 15:14:39.060631 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:39.060602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" event={"ID":"08903c86-d49c-40df-94e5-1205f3521926","Type":"ContainerStarted","Data":"fcb807ebb301d515388b54add9229668192b1d8cdd489fce92ca2d017977306a"} Jul 21 15:14:39.081877 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:39.081831 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" podStartSLOduration=1.835106416 podStartE2EDuration="2.081803635s" totalImagesPullingTime="246.697219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:14:39.079996406 +0000 UTC m=+902.082250792" watchObservedRunningTime="2026-07-21 15:14:39.081803635 +0000 UTC m=+902.084058022" Jul 21 15:14:47.862066 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:47.862023 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:47.865220 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:47.862092 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:47.875964 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:47.875939 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:48.115285 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:48.115194 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-68hwr" Jul 21 15:14:51.927903 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:51.927866 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf"] Jul 21 15:14:51.931871 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:51.931850 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:51.934656 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:51.934640 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 21 15:14:51.940693 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:51.940668 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf"] Jul 21 15:14:51.958756 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:51.958719 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:14:52.006072 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006036 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcf2769-219e-4052-9ee5-028c77b099e1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.006276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006107 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.006276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006171 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.006276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.006276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006235 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.006421 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.006279 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x48h2\" (UniqueName: \"kubernetes.io/projected/8dcf2769-219e-4052-9ee5-028c77b099e1-kube-api-access-x48h2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107172 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107111 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcf2769-219e-4052-9ee5-028c77b099e1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107345 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107345 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107252 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107345 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107277 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107468 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107412 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107520 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107471 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x48h2\" (UniqueName: \"kubernetes.io/projected/8dcf2769-219e-4052-9ee5-028c77b099e1-kube-api-access-x48h2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107758 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107729 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107878 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107758 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.107878 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.107777 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.110234 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.110203 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dcf2769-219e-4052-9ee5-028c77b099e1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.110400 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.110382 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcf2769-219e-4052-9ee5-028c77b099e1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.115974 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.115954 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x48h2\" (UniqueName: \"kubernetes.io/projected/8dcf2769-219e-4052-9ee5-028c77b099e1-kube-api-access-x48h2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf\" (UID: \"8dcf2769-219e-4052-9ee5-028c77b099e1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.243358 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.243262 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:14:52.377494 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:52.377469 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf"] Jul 21 15:14:52.380102 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:14:52.380068 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcf2769_219e_4052_9ee5_028c77b099e1.slice/crio-140e6f63846bab420acaf52ba9ff7c26aa8d838a385d1ee5e9c87ecdc9d0067c WatchSource:0}: Error finding container 140e6f63846bab420acaf52ba9ff7c26aa8d838a385d1ee5e9c87ecdc9d0067c: Status 404 returned error can't find the container with id 140e6f63846bab420acaf52ba9ff7c26aa8d838a385d1ee5e9c87ecdc9d0067c Jul 21 15:14:53.129650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:53.129612 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" event={"ID":"8dcf2769-219e-4052-9ee5-028c77b099e1","Type":"ContainerStarted","Data":"a144a16f6d6176fce41ff40e5856562cb2de40208f75e22db658eea192f28002"} Jul 21 15:14:53.130120 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:53.129671 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" event={"ID":"8dcf2769-219e-4052-9ee5-028c77b099e1","Type":"ContainerStarted","Data":"140e6f63846bab420acaf52ba9ff7c26aa8d838a385d1ee5e9c87ecdc9d0067c"} Jul 21 15:14:53.147001 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:14:53.146836 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" podStartSLOduration=1.881341088 podStartE2EDuration="2.146813977s" totalImagesPullingTime="265.472889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:14:53.146174006 +0000 UTC m=+916.148428390" watchObservedRunningTime="2026-07-21 15:14:53.146813977 +0000 UTC m=+916.149068367" Jul 21 15:15:02.035901 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:02.035866 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:15:02.243686 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:02.243633 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:15:02.243871 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:02.243755 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:15:02.256044 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:02.256019 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:15:03.185630 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:03.185602 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf" Jul 21 15:15:16.146767 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:16.146725 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:15:24.937945 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:24.937900 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:15:24.992616 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:15:24.992588 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:18.936614 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:18.936472 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:19.099038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:19.099002 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:20.075584 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:20.075553 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:20.173843 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:20.173812 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:25.829621 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:25.829590 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:16:25.930357 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:16:25.930312 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:06.571904 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:06.571849 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:15.742382 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:15.742307 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:23.057695 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:23.057639 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:23.116993 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:23.116960 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:34.568819 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:34.568742 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:17:34.669587 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:17:34.669535 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:18:34.443746 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:18:34.443709 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:18:35.985118 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:18:35.985082 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:12.339554 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:12.339330 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:12.650837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:12.650798 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:12.754755 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:12.754727 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:18.792116 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:18.792054 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:18.902301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:18.902267 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:18.992568 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:18.992533 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:19.444122 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:19.444094 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:25.458420 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:25.458361 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:25.521820 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:25.521786 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:19:37.481299 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:37.481273 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:19:37.487328 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:37.487310 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:19:40.654714 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:19:40.654678 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:22:22.602518 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:22:22.602439 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:22:46.889202 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:22:46.889166 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:24:37.508586 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:24:37.508558 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:24:37.515070 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:24:37.515048 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:26:45.790210 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:26:45.790089 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:27:05.008834 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:27:05.008786 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:27:28.998466 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:27:28.998435 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:27:30.242116 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:27:30.242053 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:28:23.535557 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:28:23.535505 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:29:09.301271 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:29:09.301240 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:29:37.535979 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:29:37.535953 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:29:37.542758 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:29:37.542736 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:30:00.150974 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.150936 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h"] Jul 21 15:30:00.154220 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.154203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" Jul 21 15:30:00.156923 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.156902 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:30:00.163818 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.163799 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" Jul 21 15:30:00.183754 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.183671 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h"] Jul 21 15:30:00.310220 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.310192 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h"] Jul 21 15:30:00.312308 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:30:00.312283 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b0945a_c3da_4d5e_9c05_bacc1a1c9534.slice/crio-7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5 WatchSource:0}: Error finding container 7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5: Status 404 returned error can't find the container with id 7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5 Jul 21 15:30:00.314347 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:00.314327 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:30:01.174844 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:01.174806 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" event={"ID":"a8b0945a-c3da-4d5e-9c05-bacc1a1c9534","Type":"ContainerStarted","Data":"7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5"} Jul 21 15:30:03.186672 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:03.186634 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" event={"ID":"a8b0945a-c3da-4d5e-9c05-bacc1a1c9534","Type":"ContainerStarted","Data":"054623d16508c5fdb324bf1d48e0ebea8bdf5c8bf5a38a810ae75bfbab5582f2"} Jul 21 15:30:03.207536 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:03.207480 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" podStartSLOduration=0.812599546 podStartE2EDuration="3.207462586s" totalImagesPullingTime="2.39486304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:03.206182141 +0000 UTC m=+1826.208436530" watchObservedRunningTime="2026-07-21 15:30:03.207462586 +0000 UTC m=+1826.209716974" Jul 21 15:30:04.192883 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:04.192846 2585 generic.go:356] "Generic (PLEG): container finished" podID="a8b0945a-c3da-4d5e-9c05-bacc1a1c9534" containerID="054623d16508c5fdb324bf1d48e0ebea8bdf5c8bf5a38a810ae75bfbab5582f2" exitCode=0 Jul 21 15:30:04.193326 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:04.192904 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" event={"ID":"a8b0945a-c3da-4d5e-9c05-bacc1a1c9534","Type":"ContainerDied","Data":"054623d16508c5fdb324bf1d48e0ebea8bdf5c8bf5a38a810ae75bfbab5582f2"} Jul 21 15:30:05.331317 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:05.331292 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" Jul 21 15:30:06.204021 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:06.203984 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" event={"ID":"a8b0945a-c3da-4d5e-9c05-bacc1a1c9534","Type":"ContainerDied","Data":"7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5"} Jul 21 15:30:06.204234 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:06.204042 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7489da9c7c4b67e5a55ee5e908aace6fdbdd42a5d00c23138b03f7e4b62a72f5" Jul 21 15:30:06.204234 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:06.204003 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h" Jul 21 15:30:25.376237 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:25.376195 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:25.473706 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:25.473673 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:25.881920 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:25.881887 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:33.529843 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:33.529812 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:33.663207 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:33.663172 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:34.981235 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:34.981201 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:35.089790 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:35.089759 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:35.179674 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:35.179639 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:35.351304 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:35.351277 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:35.654324 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:35.654240 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:30:35.810768 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:30:35.810740 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:31:00.875522 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.875438 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv"] Jul 21 15:31:00.875970 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.875804 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b0945a-c3da-4d5e-9c05-bacc1a1c9534" containerName="cleanup" Jul 21 15:31:00.875970 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.875816 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b0945a-c3da-4d5e-9c05-bacc1a1c9534" containerName="cleanup" Jul 21 15:31:00.875970 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.875877 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b0945a-c3da-4d5e-9c05-bacc1a1c9534" containerName="cleanup" Jul 21 15:31:00.878065 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.878049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:00.880733 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.880709 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:31:00.880843 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.880750 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:31:00.889849 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.889811 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv"] Jul 21 15:31:00.997881 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:00.997829 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv\" (UID: \"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:01.098482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:01.098447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv\" (UID: \"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:01.099038 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:01.099019 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv\" (UID: \"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:01.190134 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:01.190042 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:01.323384 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:01.323355 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv"] Jul 21 15:31:01.325780 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:31:01.325750 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16216d2_e0d5_496b_b5eb_2adc8a57cd1a.slice/crio-eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff WatchSource:0}: Error finding container eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff: Status 404 returned error can't find the container with id eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff Jul 21 15:31:01.452615 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:01.452534 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" event={"ID":"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a","Type":"ContainerStarted","Data":"eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff"} Jul 21 15:31:02.459372 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:02.459338 2585 generic.go:356] "Generic (PLEG): container finished" podID="f16216d2-e0d5-496b-b5eb-2adc8a57cd1a" containerID="620c8ebca19e5d4f678eaf4900495ffe91777a722fe95caf5614dba9d4a80ef7" exitCode=0 Jul 21 15:31:02.459750 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:02.459408 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" event={"ID":"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a","Type":"ContainerDied","Data":"620c8ebca19e5d4f678eaf4900495ffe91777a722fe95caf5614dba9d4a80ef7"} Jul 21 15:31:03.589300 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:03.589269 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:03.724014 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:03.723924 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca\") pod \"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a\" (UID: \"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a\") " Jul 21 15:31:03.724333 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:03.724311 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f16216d2-e0d5-496b-b5eb-2adc8a57cd1a" (UID: "f16216d2-e0d5-496b-b5eb-2adc8a57cd1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:31:03.825680 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:03.825648 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16216d2-e0d5-496b-b5eb-2adc8a57cd1a-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:31:04.469508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:04.469476 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" Jul 21 15:31:04.469508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:04.469485 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv" event={"ID":"f16216d2-e0d5-496b-b5eb-2adc8a57cd1a","Type":"ContainerDied","Data":"eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff"} Jul 21 15:31:04.469720 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:04.469538 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eff562ed10c127f21c627d546967a40659e2efe651597a0d777d6089993aecff" Jul 21 15:31:11.385343 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:11.385303 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:31:38.147328 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:38.147289 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:31:38.202640 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:31:38.202610 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:33:57.056303 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:33:57.056271 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:34:06.965594 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:06.965514 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:34:29.154889 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.154855 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb"] Jul 21 15:34:29.155389 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.155213 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16216d2-e0d5-496b-b5eb-2adc8a57cd1a" containerName="revoke-keys" Jul 21 15:34:29.155389 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.155224 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16216d2-e0d5-496b-b5eb-2adc8a57cd1a" containerName="revoke-keys" Jul 21 15:34:29.155389 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.155300 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16216d2-e0d5-496b-b5eb-2adc8a57cd1a" containerName="revoke-keys" Jul 21 15:34:29.157280 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.157266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:29.159807 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.159781 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:34:29.159807 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.159801 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:34:29.165594 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.165570 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb"] Jul 21 15:34:29.257852 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.257815 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb\" (UID: \"c6c19dbf-9b15-41cc-8169-74285f70cd45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:29.359042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.358997 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb\" (UID: \"c6c19dbf-9b15-41cc-8169-74285f70cd45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:29.359660 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.359639 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb\" (UID: \"c6c19dbf-9b15-41cc-8169-74285f70cd45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:29.469237 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.469110 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:29.603777 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:29.603747 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb"] Jul 21 15:34:29.606516 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:34:29.606493 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c19dbf_9b15_41cc_8169_74285f70cd45.slice/crio-9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa WatchSource:0}: Error finding container 9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa: Status 404 returned error can't find the container with id 9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa Jul 21 15:34:30.423530 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:30.423496 2585 generic.go:356] "Generic (PLEG): container finished" podID="c6c19dbf-9b15-41cc-8169-74285f70cd45" containerID="87a2bfefbe531a3e105bc7a2a0919c8459470a8285af3403dc1233fe58c64c02" exitCode=0 Jul 21 15:34:30.423887 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:30.423585 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" event={"ID":"c6c19dbf-9b15-41cc-8169-74285f70cd45","Type":"ContainerDied","Data":"87a2bfefbe531a3e105bc7a2a0919c8459470a8285af3403dc1233fe58c64c02"} Jul 21 15:34:30.423887 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:30.423636 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" event={"ID":"c6c19dbf-9b15-41cc-8169-74285f70cd45","Type":"ContainerStarted","Data":"9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa"} Jul 21 15:34:31.554943 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:31.554917 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:31.680547 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:31.680444 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca\") pod \"c6c19dbf-9b15-41cc-8169-74285f70cd45\" (UID: \"c6c19dbf-9b15-41cc-8169-74285f70cd45\") " Jul 21 15:34:31.680819 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:31.680797 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6c19dbf-9b15-41cc-8169-74285f70cd45" (UID: "c6c19dbf-9b15-41cc-8169-74285f70cd45"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:34:31.781335 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:31.781293 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c19dbf-9b15-41cc-8169-74285f70cd45-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:34:32.434109 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:32.434080 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" Jul 21 15:34:32.434306 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:32.434126 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb" event={"ID":"c6c19dbf-9b15-41cc-8169-74285f70cd45","Type":"ContainerDied","Data":"9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa"} Jul 21 15:34:32.434306 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:32.434196 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9537412291cc5c460313112df39a1024487e961464182e91b429b712f0e79dfa" Jul 21 15:34:37.565969 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:37.565936 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:34:37.574792 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:37.574768 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:34:39.612886 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:39.612851 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:34:42.701740 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:34:42.701703 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:36:57.483492 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:36:57.483460 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:29.301595 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:29.301536 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:29.532891 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:29.532861 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:29.784885 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:29.784854 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:30.136464 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:30.136430 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:30.268867 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:30.268827 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:32.183417 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:32.183375 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:32.291171 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:32.291113 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:32.960165 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:32.960124 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:33.060391 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:33.060341 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:33.162046 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:33.162014 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:37:58.026040 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.026000 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5"] Jul 21 15:37:58.026626 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.026453 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c19dbf-9b15-41cc-8169-74285f70cd45" containerName="revoke-keys" Jul 21 15:37:58.026626 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.026465 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c19dbf-9b15-41cc-8169-74285f70cd45" containerName="revoke-keys" Jul 21 15:37:58.026626 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.026545 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c19dbf-9b15-41cc-8169-74285f70cd45" containerName="revoke-keys" Jul 21 15:37:58.028672 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.028653 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:37:58.031276 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.031257 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:37:58.031385 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.031280 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:37:58.035919 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.035889 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5"] Jul 21 15:37:58.055956 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.055926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5\" (UID: \"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:37:58.156892 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.156853 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5\" (UID: \"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:37:58.157588 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.157557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5\" (UID: \"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:37:58.343058 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.342962 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:37:58.482652 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:58.482624 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5"] Jul 21 15:37:58.484700 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:37:58.484664 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea76ba51_9e1e_4dcb_8849_8b7cdef3feb3.slice/crio-9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b WatchSource:0}: Error finding container 9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b: Status 404 returned error can't find the container with id 9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b Jul 21 15:37:59.395600 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:59.395565 2585 generic.go:356] "Generic (PLEG): container finished" podID="ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3" containerID="7eee9814910809a8ca38cc9c4cd937de7679ed29a337881ae62cba36d8693d16" exitCode=0 Jul 21 15:37:59.396003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:59.395612 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" event={"ID":"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3","Type":"ContainerDied","Data":"7eee9814910809a8ca38cc9c4cd937de7679ed29a337881ae62cba36d8693d16"} Jul 21 15:37:59.396003 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:37:59.395666 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" event={"ID":"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3","Type":"ContainerStarted","Data":"9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b"} Jul 21 15:38:00.531549 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:00.531523 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:38:00.580714 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:00.580685 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca\") pod \"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3\" (UID: \"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3\") " Jul 21 15:38:00.581072 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:00.581050 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3" (UID: "ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:38:00.681960 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:00.681869 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:38:01.407343 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:01.407317 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" Jul 21 15:38:01.407510 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:01.407312 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5" event={"ID":"ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3","Type":"ContainerDied","Data":"9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b"} Jul 21 15:38:01.407510 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:01.407389 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b1543226731b09a6046d42ce6ab51c4590b3a55c8c383fcfabb0b707994b23b" Jul 21 15:38:08.552255 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:08.552215 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:38:56.740013 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:56.739959 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:38:57.876412 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:57.876382 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:38:57.974607 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:38:57.974575 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:39:37.594617 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:39:37.594589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:39:37.603225 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:39:37.603202 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:42:13.176162 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:42:13.176126 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:41.430829 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:41.430792 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:58.308110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:58.308080 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:58.561577 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:58.561491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:58.838804 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:58.838721 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:59.156087 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:59.156056 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:43:59.299925 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:43:59.299890 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:01.402971 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:01.402937 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:01.491668 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:01.491633 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:01.592456 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:01.592419 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:01.739984 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:01.739896 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:02.069467 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:02.069375 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:02.171301 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:02.171269 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:26.244399 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.244366 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w"] Jul 21 15:44:26.244954 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.244923 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3" containerName="revoke-keys" Jul 21 15:44:26.244954 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.244947 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3" containerName="revoke-keys" Jul 21 15:44:26.245164 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.245070 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3" containerName="revoke-keys" Jul 21 15:44:26.247398 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.247380 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:26.250058 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.250033 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:44:26.250181 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.250109 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:44:26.255351 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.255324 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w"] Jul 21 15:44:26.323813 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.323766 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5195cc17-sr26w\" (UID: \"e464bdab-3103-44c9-aea9-95944fd39287\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:26.424394 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.424347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5195cc17-sr26w\" (UID: \"e464bdab-3103-44c9-aea9-95944fd39287\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:26.424944 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.424925 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5195cc17-sr26w\" (UID: \"e464bdab-3103-44c9-aea9-95944fd39287\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:26.559667 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.559580 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:26.689827 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:26.689802 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w"] Jul 21 15:44:26.692339 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:44:26.692317 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode464bdab_3103_44c9_aea9_95944fd39287.slice/crio-bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7 WatchSource:0}: Error finding container bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7: Status 404 returned error can't find the container with id bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7 Jul 21 15:44:27.214219 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:27.214108 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" event={"ID":"e464bdab-3103-44c9-aea9-95944fd39287","Type":"ContainerStarted","Data":"2bc1e8fa842e12375cb9578b98efd2a111fdbd81a6888d0e26684f5632863edc"} Jul 21 15:44:27.214219 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:27.214177 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" event={"ID":"e464bdab-3103-44c9-aea9-95944fd39287","Type":"ContainerStarted","Data":"bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7"} Jul 21 15:44:27.229392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:27.229346 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" podStartSLOduration=1.229329744 podStartE2EDuration="1.229329744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:44:27.228243793 +0000 UTC m=+2690.230498194" watchObservedRunningTime="2026-07-21 15:44:27.229329744 +0000 UTC m=+2690.231584130" Jul 21 15:44:28.221413 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:28.221377 2585 generic.go:356] "Generic (PLEG): container finished" podID="e464bdab-3103-44c9-aea9-95944fd39287" containerID="2bc1e8fa842e12375cb9578b98efd2a111fdbd81a6888d0e26684f5632863edc" exitCode=0 Jul 21 15:44:28.221800 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:28.221431 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" event={"ID":"e464bdab-3103-44c9-aea9-95944fd39287","Type":"ContainerDied","Data":"2bc1e8fa842e12375cb9578b98efd2a111fdbd81a6888d0e26684f5632863edc"} Jul 21 15:44:29.354391 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:29.354363 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:29.451798 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:29.451755 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca\") pod \"e464bdab-3103-44c9-aea9-95944fd39287\" (UID: \"e464bdab-3103-44c9-aea9-95944fd39287\") " Jul 21 15:44:29.452115 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:29.452089 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e464bdab-3103-44c9-aea9-95944fd39287" (UID: "e464bdab-3103-44c9-aea9-95944fd39287"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:44:29.552667 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:29.552548 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e464bdab-3103-44c9-aea9-95944fd39287-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:44:30.232437 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:30.232404 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" Jul 21 15:44:30.232437 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:30.232411 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5195cc17-sr26w" event={"ID":"e464bdab-3103-44c9-aea9-95944fd39287","Type":"ContainerDied","Data":"bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7"} Jul 21 15:44:30.232646 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:30.232455 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf14b6c0ffd0c3bb32bde188e475392e61d152a0f2e5155ac49cd077cbd533c7" Jul 21 15:44:36.700176 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:36.700121 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:44:37.621887 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:37.621861 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:44:37.637872 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:44:37.637845 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:45:00.139557 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.139521 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk"] Jul 21 15:45:00.140024 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.139861 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e464bdab-3103-44c9-aea9-95944fd39287" containerName="revoke-keys" Jul 21 15:45:00.140024 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.139872 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e464bdab-3103-44c9-aea9-95944fd39287" containerName="revoke-keys" Jul 21 15:45:00.140024 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.139958 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e464bdab-3103-44c9-aea9-95944fd39287" containerName="revoke-keys" Jul 21 15:45:00.141902 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.141886 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" Jul 21 15:45:00.144472 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.144449 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:45:00.151802 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.151781 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk"] Jul 21 15:45:00.152454 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.152439 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" Jul 21 15:45:00.284484 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.284452 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk"] Jul 21 15:45:00.287680 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:45:00.287650 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4961e6b_eaeb_4c11_8a39_62eef1808df5.slice/crio-6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7 WatchSource:0}: Error finding container 6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7: Status 404 returned error can't find the container with id 6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7 Jul 21 15:45:00.378280 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:00.378243 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" event={"ID":"c4961e6b-eaeb-4c11-8a39-62eef1808df5","Type":"ContainerStarted","Data":"6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7"} Jul 21 15:45:01.384768 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:01.384735 2585 generic.go:356] "Generic (PLEG): container finished" podID="c4961e6b-eaeb-4c11-8a39-62eef1808df5" containerID="679538f05a5204fb79620a85c7496a66405decc33d3754acfcf82cbb62571d0e" exitCode=0 Jul 21 15:45:01.385139 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:01.384792 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" event={"ID":"c4961e6b-eaeb-4c11-8a39-62eef1808df5","Type":"ContainerDied","Data":"679538f05a5204fb79620a85c7496a66405decc33d3754acfcf82cbb62571d0e"} Jul 21 15:45:02.522284 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:02.522258 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" Jul 21 15:45:03.395557 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:03.395525 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" Jul 21 15:45:03.395738 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:03.395527 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744145-7wwdk" event={"ID":"c4961e6b-eaeb-4c11-8a39-62eef1808df5","Type":"ContainerDied","Data":"6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7"} Jul 21 15:45:03.395738 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:03.395653 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d6842d0ff94f882f4808c26d2be0d506663a731451c5ed2f77a5c6c92cd8ea7" Jul 21 15:45:24.703061 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:45:24.703024 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:26.565590 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:26.565560 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:28.193803 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:28.193718 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:28.838740 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:28.838702 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:34.727874 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:34.727842 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:34.793603 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:34.793558 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:34.877226 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:34.877193 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:34.982863 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:34.982784 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:35.086683 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:35.086653 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:47:35.487001 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:47:35.486969 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:01.474899 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:01.474857 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:07.275281 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:07.275246 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:07.382757 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:07.382728 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:07.475936 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:07.475908 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:22.742084 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:22.742042 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:23.568629 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:23.568597 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:29.293091 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:29.293056 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:29.405042 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:29.405014 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:29.494318 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:29.494285 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:40.027188 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:40.027138 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:40.856223 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:40.856191 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:46.899082 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:46.899049 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:47.053367 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:47.053325 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:47.142110 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:47.142071 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:47.242508 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:47.242426 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:47.996169 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:47.996110 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:48.091598 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:48.091569 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:48.274368 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:48.274278 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:50.037965 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:50.037924 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:55.748270 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:55.748232 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:55.819159 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:55.819112 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:56.460058 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:56.460028 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:59.175688 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:59.175610 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:59.273949 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:59.273915 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:48:59.982820 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:48:59.982790 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:00.050312 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:00.050279 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:02.204767 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:02.204737 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:02.305693 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:02.305667 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:02.462019 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:02.461935 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:02.790765 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:02.790674 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:03.018594 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:03.018557 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:05.813585 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:05.813555 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:05.918431 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:05.918391 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:06.082653 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:06.082563 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:06.445089 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:06.445058 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:06.653307 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:06.653275 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:06.753330 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:06.753252 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:10.288200 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:10.288165 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:10.973387 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:10.973354 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:11.074837 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:11.074804 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:11.368648 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:11.368610 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:17.200582 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.200553 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:17.315293 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.315265 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:17.483592 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.483503 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd"] Jul 21 15:49:17.483860 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.483847 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4961e6b-eaeb-4c11-8a39-62eef1808df5" containerName="cleanup" Jul 21 15:49:17.483915 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.483862 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4961e6b-eaeb-4c11-8a39-62eef1808df5" containerName="cleanup" Jul 21 15:49:17.483962 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.483940 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4961e6b-eaeb-4c11-8a39-62eef1808df5" containerName="cleanup" Jul 21 15:49:17.486888 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.486871 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:17.489373 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.489349 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:49:17.489473 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.489432 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:49:17.494926 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.494902 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd"] Jul 21 15:49:17.544392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.544359 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd\" (UID: \"5765e483-224f-44d7-b333-54bb29cb7917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:17.645463 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.645425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd\" (UID: \"5765e483-224f-44d7-b333-54bb29cb7917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:17.646106 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.646085 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd\" (UID: \"5765e483-224f-44d7-b333-54bb29cb7917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:17.797863 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.797766 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:17.935246 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:17.935215 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd"] Jul 21 15:49:17.937458 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:49:17.937425 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5765e483_224f_44d7_b333_54bb29cb7917.slice/crio-770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff WatchSource:0}: Error finding container 770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff: Status 404 returned error can't find the container with id 770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff Jul 21 15:49:18.596226 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:18.596109 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" event={"ID":"5765e483-224f-44d7-b333-54bb29cb7917","Type":"ContainerStarted","Data":"d2931d30ee5b5d4962eb5f7115e08c291b4e0c2336d1f61e16b207414e58f9bd"} Jul 21 15:49:18.596226 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:18.596176 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" event={"ID":"5765e483-224f-44d7-b333-54bb29cb7917","Type":"ContainerStarted","Data":"770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff"} Jul 21 15:49:18.612521 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:18.612479 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" podStartSLOduration=1.612464213 podStartE2EDuration="1.612464213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:49:18.610817812 +0000 UTC m=+2981.613072216" watchObservedRunningTime="2026-07-21 15:49:18.612464213 +0000 UTC m=+2981.614718600" Jul 21 15:49:19.602258 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:19.602215 2585 generic.go:356] "Generic (PLEG): container finished" podID="5765e483-224f-44d7-b333-54bb29cb7917" containerID="d2931d30ee5b5d4962eb5f7115e08c291b4e0c2336d1f61e16b207414e58f9bd" exitCode=0 Jul 21 15:49:19.602674 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:19.602312 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" event={"ID":"5765e483-224f-44d7-b333-54bb29cb7917","Type":"ContainerDied","Data":"d2931d30ee5b5d4962eb5f7115e08c291b4e0c2336d1f61e16b207414e58f9bd"} Jul 21 15:49:20.737053 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:20.737031 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:20.877394 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:20.877302 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca\") pod \"5765e483-224f-44d7-b333-54bb29cb7917\" (UID: \"5765e483-224f-44d7-b333-54bb29cb7917\") " Jul 21 15:49:20.877655 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:20.877630 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5765e483-224f-44d7-b333-54bb29cb7917" (UID: "5765e483-224f-44d7-b333-54bb29cb7917"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:49:20.978360 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:20.978326 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5765e483-224f-44d7-b333-54bb29cb7917-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:49:21.613583 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:21.613557 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" Jul 21 15:49:21.613583 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:21.613561 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd" event={"ID":"5765e483-224f-44d7-b333-54bb29cb7917","Type":"ContainerDied","Data":"770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff"} Jul 21 15:49:21.613839 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:21.613610 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="770b005fceb006cb751e140de0865d6cd2e4507a02958282ef273ae427e187ff" Jul 21 15:49:27.956111 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:27.956078 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:49:37.652449 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:37.652421 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:49:37.669552 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:49:37.669528 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:51:41.151089 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:51:41.151055 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:18.531945 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:18.531861 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:23.863001 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:23.862967 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:23.919340 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:23.919304 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:24.134507 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:24.134426 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:24.390481 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:24.390391 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:24.525483 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:24.525450 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:24.623797 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:24.623751 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:24.752988 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:24.752908 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:30.447838 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:30.447800 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:32.610570 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:32.610536 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:36.686570 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:36.686536 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:36.757913 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:36.757877 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:43.583650 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:43.583607 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:43.898839 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:43.898810 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:44.424562 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:44.424534 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:46.885951 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:46.885919 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:46.973458 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:46.973423 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:47.044616 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:47.044585 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:47.329500 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:47.329417 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:47.674382 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:47.674348 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:47.776255 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:47.776223 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:51.385228 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:51.385191 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:52:57.478162 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:52:57.478125 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:53:24.901666 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.901630 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8"] Jul 21 15:53:24.902210 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.901980 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5765e483-224f-44d7-b333-54bb29cb7917" containerName="revoke-keys" Jul 21 15:53:24.902210 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.901991 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5765e483-224f-44d7-b333-54bb29cb7917" containerName="revoke-keys" Jul 21 15:53:24.902210 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.902053 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5765e483-224f-44d7-b333-54bb29cb7917" containerName="revoke-keys" Jul 21 15:53:24.904983 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.904967 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:24.907569 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.907550 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:53:24.907924 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.907909 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 15:53:24.915319 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.915299 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8"] Jul 21 15:53:24.974923 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:24.974896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8\" (UID: \"3b7eab0c-613a-409f-990c-1273cb656314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:25.076191 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.076124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8\" (UID: \"3b7eab0c-613a-409f-990c-1273cb656314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:25.076747 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.076727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8\" (UID: \"3b7eab0c-613a-409f-990c-1273cb656314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:25.215908 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.215834 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:25.344344 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.344310 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8"] Jul 21 15:53:25.346610 ip-10-0-129-25 kubenswrapper[2585]: W0721 15:53:25.346586 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7eab0c_613a_409f_990c_1273cb656314.slice/crio-499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca WatchSource:0}: Error finding container 499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca: Status 404 returned error can't find the container with id 499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca Jul 21 15:53:25.769257 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.768586 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" event={"ID":"3b7eab0c-613a-409f-990c-1273cb656314","Type":"ContainerStarted","Data":"2edbe81cbb08aa435f6853a16158df3f3e75e09c60e7033013aa664b7c28e37d"} Jul 21 15:53:25.769257 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.768650 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" event={"ID":"3b7eab0c-613a-409f-990c-1273cb656314","Type":"ContainerStarted","Data":"499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca"} Jul 21 15:53:25.785314 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:25.785266 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" podStartSLOduration=1.78525058 podStartE2EDuration="1.78525058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:53:25.783679046 +0000 UTC m=+3228.785933433" watchObservedRunningTime="2026-07-21 15:53:25.78525058 +0000 UTC m=+3228.787504978" Jul 21 15:53:26.774392 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:26.774360 2585 generic.go:356] "Generic (PLEG): container finished" podID="3b7eab0c-613a-409f-990c-1273cb656314" containerID="2edbe81cbb08aa435f6853a16158df3f3e75e09c60e7033013aa664b7c28e37d" exitCode=0 Jul 21 15:53:26.774779 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:26.774409 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" event={"ID":"3b7eab0c-613a-409f-990c-1273cb656314","Type":"ContainerDied","Data":"2edbe81cbb08aa435f6853a16158df3f3e75e09c60e7033013aa664b7c28e37d"} Jul 21 15:53:27.908237 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:27.908215 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:28.002669 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.002640 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca\") pod \"3b7eab0c-613a-409f-990c-1273cb656314\" (UID: \"3b7eab0c-613a-409f-990c-1273cb656314\") " Jul 21 15:53:28.003002 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.002980 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b7eab0c-613a-409f-990c-1273cb656314" (UID: "3b7eab0c-613a-409f-990c-1273cb656314"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:53:28.104161 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.104107 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7eab0c-613a-409f-990c-1273cb656314-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 15:53:28.785215 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.785187 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" Jul 21 15:53:28.785215 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.785208 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8" event={"ID":"3b7eab0c-613a-409f-990c-1273cb656314","Type":"ContainerDied","Data":"499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca"} Jul 21 15:53:28.785417 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:28.785256 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="499ae3d98030883f4f918ec44cba38ec9444130bbb6d79d8807d7b66b97da0ca" Jul 21 15:53:36.519510 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:36.519476 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:53:44.833371 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:44.833334 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:53:50.996482 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:53:50.996440 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:54:00.107463 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:00.107430 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:54:00.204415 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:00.204364 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:54:25.426189 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:25.426133 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:54:37.682258 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:37.682215 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:54:37.701811 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:37.701787 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:54:38.061215 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:54:38.061121 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:57:21.843937 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:57:21.843901 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 15:59:37.711663 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:59:37.711639 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 15:59:37.730853 ip-10-0-129-25 kubenswrapper[2585]: I0721 15:59:37.730829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:00:00.144350 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.144315 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f"] Jul 21 16:00:00.144738 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.144652 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7eab0c-613a-409f-990c-1273cb656314" containerName="revoke-keys" Jul 21 16:00:00.144738 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.144663 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7eab0c-613a-409f-990c-1273cb656314" containerName="revoke-keys" Jul 21 16:00:00.144738 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.144731 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7eab0c-613a-409f-990c-1273cb656314" containerName="revoke-keys" Jul 21 16:00:00.147697 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.147681 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" Jul 21 16:00:00.150136 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.150111 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:00:00.157237 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.157220 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" Jul 21 16:00:00.162673 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.162643 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f"] Jul 21 16:00:00.295675 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.295650 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f"] Jul 21 16:00:00.297695 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:00:00.297664 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc12697_8abc_4d02_9f71_dfcaf9064e50.slice/crio-9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24 WatchSource:0}: Error finding container 9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24: Status 404 returned error can't find the container with id 9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24 Jul 21 16:00:00.661364 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.661328 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" event={"ID":"9fc12697-8abc-4d02-9f71-dfcaf9064e50","Type":"ContainerStarted","Data":"da1ba4c9ca36cdec89d9b09e7b012f4969cdb30e5af595875a9ea5341fa84cc6"} Jul 21 16:00:00.661536 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.661378 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" event={"ID":"9fc12697-8abc-4d02-9f71-dfcaf9064e50","Type":"ContainerStarted","Data":"9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24"} Jul 21 16:00:00.675991 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:00.675933 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" podStartSLOduration=0.67591953 podStartE2EDuration="675.91953ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:00:00.675106765 +0000 UTC m=+3623.677361146" watchObservedRunningTime="2026-07-21 16:00:00.67591953 +0000 UTC m=+3623.678173983" Jul 21 16:00:01.668269 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:01.668227 2585 generic.go:356] "Generic (PLEG): container finished" podID="9fc12697-8abc-4d02-9f71-dfcaf9064e50" containerID="da1ba4c9ca36cdec89d9b09e7b012f4969cdb30e5af595875a9ea5341fa84cc6" exitCode=0 Jul 21 16:00:01.668673 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:01.668318 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" event={"ID":"9fc12697-8abc-4d02-9f71-dfcaf9064e50","Type":"ContainerDied","Data":"da1ba4c9ca36cdec89d9b09e7b012f4969cdb30e5af595875a9ea5341fa84cc6"} Jul 21 16:00:02.804974 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:02.804947 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" Jul 21 16:00:03.679695 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:03.679661 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" Jul 21 16:00:03.679695 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:03.679682 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744160-v846f" event={"ID":"9fc12697-8abc-4d02-9f71-dfcaf9064e50","Type":"ContainerDied","Data":"9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24"} Jul 21 16:00:03.679893 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:00:03.679735 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ded079d0f7f72ac57733c3913f69de981eab95c346299dae7405cc706229c24" Jul 21 16:02:30.338862 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:02:30.338761 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:02:36.265103 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:02:36.265066 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:11.697115 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:11.697078 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:12.364089 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:12.364056 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:18.027620 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:18.027588 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:18.128418 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:18.128387 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:18.353125 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:18.353086 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:18.601362 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:18.601325 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:19.778964 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:19.778929 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:19.877552 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:19.877519 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:19.977584 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:19.977545 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:20.776033 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:20.775999 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:20.878865 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:20.878826 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:20.979389 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:20.979349 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:22.490025 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:22.489957 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:28.389975 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:28.389938 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:28.744811 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:28.744728 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:29.076043 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:29.075943 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:34.780440 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:34.780401 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:35.143245 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:35.143210 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:35.243494 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:35.243461 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:45.572270 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:45.572225 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:03:47.081427 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:03:47.081396 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:06.964840 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:06.964808 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:12.697910 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:12.697869 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:12.846085 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:12.846037 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:13.065342 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:13.065258 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:13.382104 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:13.382073 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:13.672108 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:13.672004 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:16.903885 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:16.903837 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:16.989659 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:16.989620 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:17.064138 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:17.064090 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:17.402811 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:17.402778 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:17.556928 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:17.556893 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:17.657635 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:17.657549 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:21.438359 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:21.438326 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:21.799837 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:21.799740 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:22.348018 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:22.347978 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:22.451360 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:22.451321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:24.942519 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:24.942484 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:25.025171 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:25.025109 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:25.089449 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:25.089417 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:25.189615 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:25.189576 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:25.598540 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:25.598506 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:25.696383 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:25.696344 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:29.479862 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:29.479832 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:34.927849 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:34.927809 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:37.742246 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:37.742210 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:04:37.760828 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:37.760804 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:04:38.303253 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:38.303215 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:38.404012 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:38.403971 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:46.318039 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:46.318007 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:47.826989 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:47.826945 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:04:54.861224 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:04:54.861189 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:05:13.086416 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:05:13.086377 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:02.457804 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:02.457763 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:05.645749 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:05.645709 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:06.557408 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.557372 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:06.684873 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.684839 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n"] Jul 21 16:06:06.685259 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.685226 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc12697-8abc-4d02-9f71-dfcaf9064e50" containerName="cleanup" Jul 21 16:06:06.685259 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.685238 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc12697-8abc-4d02-9f71-dfcaf9064e50" containerName="cleanup" Jul 21 16:06:06.685335 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.685296 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc12697-8abc-4d02-9f71-dfcaf9064e50" containerName="cleanup" Jul 21 16:06:06.688214 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.688198 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:06.690650 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.690624 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:06:06.690767 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.690666 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:06:06.695665 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.695423 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n"] Jul 21 16:06:06.791683 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.791649 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n\" (UID: \"2d49fda4-8aab-426a-95c3-df6483f35153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:06.892465 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.892413 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n\" (UID: \"2d49fda4-8aab-426a-95c3-df6483f35153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:06.893041 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.893019 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n\" (UID: \"2d49fda4-8aab-426a-95c3-df6483f35153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:06.999942 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:06.999900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:07.132310 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:07.130498 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n"] Jul 21 16:06:07.134337 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:06:07.134306 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d49fda4_8aab_426a_95c3_df6483f35153.slice/crio-3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14 WatchSource:0}: Error finding container 3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14: Status 404 returned error can't find the container with id 3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14 Jul 21 16:06:07.180161 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:07.180117 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:07.281967 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:07.281927 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:06:07.427538 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:07.427450 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" event={"ID":"2d49fda4-8aab-426a-95c3-df6483f35153","Type":"ContainerStarted","Data":"3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14"} Jul 21 16:06:08.434244 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:08.434205 2585 generic.go:356] "Generic (PLEG): container finished" podID="2d49fda4-8aab-426a-95c3-df6483f35153" containerID="2d2111a3b964ec20d903fe0a044a7a70858791e1a42d53e8c9b94a3111cf911d" exitCode=0 Jul 21 16:06:08.434608 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:08.434290 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" event={"ID":"2d49fda4-8aab-426a-95c3-df6483f35153","Type":"ContainerDied","Data":"2d2111a3b964ec20d903fe0a044a7a70858791e1a42d53e8c9b94a3111cf911d"} Jul 21 16:06:09.569873 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:09.569849 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:09.623782 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:09.623748 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca\") pod \"2d49fda4-8aab-426a-95c3-df6483f35153\" (UID: \"2d49fda4-8aab-426a-95c3-df6483f35153\") " Jul 21 16:06:09.624088 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:09.624066 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d49fda4-8aab-426a-95c3-df6483f35153" (UID: "2d49fda4-8aab-426a-95c3-df6483f35153"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:06:09.724584 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:09.724491 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d49fda4-8aab-426a-95c3-df6483f35153-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:06:10.445277 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:10.445243 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" event={"ID":"2d49fda4-8aab-426a-95c3-df6483f35153","Type":"ContainerDied","Data":"3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14"} Jul 21 16:06:10.445277 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:10.445277 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n" Jul 21 16:06:10.445485 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:10.445289 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a20926d18cf613f4eb4b03c3fdedcb361e973e53468c53c3aac5de8653b8e14" Jul 21 16:06:17.152979 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:06:17.152943 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:01.787476 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:01.787440 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:04.395771 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:04.395734 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:07.084931 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:07.084899 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:12.887893 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:12.887851 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:12.951343 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:12.951298 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:13.183425 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.183338 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:13.449043 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.448953 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:13.575698 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.575667 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5"] Jul 21 16:09:13.576039 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.576026 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d49fda4-8aab-426a-95c3-df6483f35153" containerName="revoke-keys" Jul 21 16:09:13.576095 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.576041 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d49fda4-8aab-426a-95c3-df6483f35153" containerName="revoke-keys" Jul 21 16:09:13.576133 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.576102 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d49fda4-8aab-426a-95c3-df6483f35153" containerName="revoke-keys" Jul 21 16:09:13.579021 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.579005 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:13.581432 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.581409 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:09:13.581529 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.581446 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:09:13.586677 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.586655 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5"] Jul 21 16:09:13.666976 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.666935 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5\" (UID: \"98c2e878-d153-4505-8922-e2b9d3ebb5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:13.768108 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.768021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5\" (UID: \"98c2e878-d153-4505-8922-e2b9d3ebb5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:13.768654 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.768637 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5\" (UID: \"98c2e878-d153-4505-8922-e2b9d3ebb5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:13.890672 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:13.890616 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:14.019629 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:14.019603 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5"] Jul 21 16:09:14.021641 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:09:14.021605 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c2e878_d153_4505_8922_e2b9d3ebb5f2.slice/crio-fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3 WatchSource:0}: Error finding container fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3: Status 404 returned error can't find the container with id fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3 Jul 21 16:09:14.069496 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:14.069463 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:14.353932 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:14.353895 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" event={"ID":"98c2e878-d153-4505-8922-e2b9d3ebb5f2","Type":"ContainerStarted","Data":"c5fda5c42ae84813d41e43d5c3ce8616f104f592c13ea4e9777127e2d410b31e"} Jul 21 16:09:14.354099 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:14.353951 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" event={"ID":"98c2e878-d153-4505-8922-e2b9d3ebb5f2","Type":"ContainerStarted","Data":"fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3"} Jul 21 16:09:14.369003 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:14.368956 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" podStartSLOduration=1.368941654 podStartE2EDuration="1.368941654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:09:14.367888438 +0000 UTC m=+4177.370142825" watchObservedRunningTime="2026-07-21 16:09:14.368941654 +0000 UTC m=+4177.371196040" Jul 21 16:09:15.359984 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:15.359950 2585 generic.go:356] "Generic (PLEG): container finished" podID="98c2e878-d153-4505-8922-e2b9d3ebb5f2" containerID="c5fda5c42ae84813d41e43d5c3ce8616f104f592c13ea4e9777127e2d410b31e" exitCode=0 Jul 21 16:09:15.360381 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:15.360041 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" event={"ID":"98c2e878-d153-4505-8922-e2b9d3ebb5f2","Type":"ContainerDied","Data":"c5fda5c42ae84813d41e43d5c3ce8616f104f592c13ea4e9777127e2d410b31e"} Jul 21 16:09:15.543791 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:15.543750 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:16.494501 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:16.494477 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:16.594730 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:16.594698 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca\") pod \"98c2e878-d153-4505-8922-e2b9d3ebb5f2\" (UID: \"98c2e878-d153-4505-8922-e2b9d3ebb5f2\") " Jul 21 16:09:16.595080 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:16.595053 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98c2e878-d153-4505-8922-e2b9d3ebb5f2" (UID: "98c2e878-d153-4505-8922-e2b9d3ebb5f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:09:16.696391 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:16.696306 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c2e878-d153-4505-8922-e2b9d3ebb5f2-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:09:17.372181 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:17.372136 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" Jul 21 16:09:17.372351 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:17.372135 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5" event={"ID":"98c2e878-d153-4505-8922-e2b9d3ebb5f2","Type":"ContainerDied","Data":"fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3"} Jul 21 16:09:17.372351 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:17.372267 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcb9901a710420333f24aa3ec6e5cce81e5bbf6da22df873212d32d5d72ee9f3" Jul 21 16:09:21.709172 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:21.709115 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:24.017642 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:24.017603 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:09:37.772054 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:37.772026 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:09:37.790785 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:09:37.790767 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:12:14.001789 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:14.001757 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:19.590374 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:19.590334 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:19.697223 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:19.697188 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:19.892687 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:19.892643 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:20.120861 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:20.120828 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:20.498352 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:20.498319 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:20.824641 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:20.824571 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:20.878920 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:20.878887 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:23.757070 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:23.757031 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:23.833554 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:23.833520 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:23.993552 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:23.993520 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:24.275288 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:24.275248 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:24.378798 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:24.378769 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:24.478204 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:24.478173 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:28.312299 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:28.312264 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:28.803983 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:28.803952 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:29.123794 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:29.123759 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:29.859188 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:29.859116 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:31.850599 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:31.850562 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:31.935631 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:31.935584 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:32.059419 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:32.059368 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:32.200509 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:32.200417 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:32.596580 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:32.596499 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:32.696110 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:32.696077 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:36.357085 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:36.357054 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:44.651952 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.651910 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw"] Jul 21 16:12:44.652549 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.652446 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c2e878-d153-4505-8922-e2b9d3ebb5f2" containerName="revoke-keys" Jul 21 16:12:44.652549 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.652465 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c2e878-d153-4505-8922-e2b9d3ebb5f2" containerName="revoke-keys" Jul 21 16:12:44.652676 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.652564 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c2e878-d153-4505-8922-e2b9d3ebb5f2" containerName="revoke-keys" Jul 21 16:12:44.655527 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.655507 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:44.657924 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.657903 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:12:44.658016 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.657931 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:12:44.663137 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.663087 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw"] Jul 21 16:12:44.750601 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.750560 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-40a33d-djwgw\" (UID: \"5f807095-f2eb-4134-8998-065e062e2e5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:44.851686 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.851638 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-40a33d-djwgw\" (UID: \"5f807095-f2eb-4134-8998-065e062e2e5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:44.852304 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.852286 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-40a33d-djwgw\" (UID: \"5f807095-f2eb-4134-8998-065e062e2e5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:44.968624 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:44.968534 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:45.108784 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.108753 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw"] Jul 21 16:12:45.110294 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:12:45.110267 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f807095_f2eb_4134_8998_065e062e2e5e.slice/crio-927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a WatchSource:0}: Error finding container 927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a: Status 404 returned error can't find the container with id 927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a Jul 21 16:12:45.126969 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.126943 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:45.226897 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.226816 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:45.398693 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.398662 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" event={"ID":"5f807095-f2eb-4134-8998-065e062e2e5e","Type":"ContainerStarted","Data":"e8c95ac924e53053872ccb59b0b5ba4c377cdee3a7eb0f2400b1379b6f74de37"} Jul 21 16:12:45.398845 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.398720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" event={"ID":"5f807095-f2eb-4134-8998-065e062e2e5e","Type":"ContainerStarted","Data":"927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a"} Jul 21 16:12:45.415361 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:45.415314 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" podStartSLOduration=1.415296964 podStartE2EDuration="1.415296964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:12:45.413167543 +0000 UTC m=+4388.415421920" watchObservedRunningTime="2026-07-21 16:12:45.415296964 +0000 UTC m=+4388.417551352" Jul 21 16:12:46.405653 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:46.405617 2585 generic.go:356] "Generic (PLEG): container finished" podID="5f807095-f2eb-4134-8998-065e062e2e5e" containerID="e8c95ac924e53053872ccb59b0b5ba4c377cdee3a7eb0f2400b1379b6f74de37" exitCode=0 Jul 21 16:12:46.406049 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:46.405693 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" event={"ID":"5f807095-f2eb-4134-8998-065e062e2e5e","Type":"ContainerDied","Data":"e8c95ac924e53053872ccb59b0b5ba4c377cdee3a7eb0f2400b1379b6f74de37"} Jul 21 16:12:47.541040 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:47.541015 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:47.672269 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:47.672171 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca\") pod \"5f807095-f2eb-4134-8998-065e062e2e5e\" (UID: \"5f807095-f2eb-4134-8998-065e062e2e5e\") " Jul 21 16:12:47.672998 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:47.672924 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f807095-f2eb-4134-8998-065e062e2e5e" (UID: "5f807095-f2eb-4134-8998-065e062e2e5e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:12:47.679532 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:47.673273 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f807095-f2eb-4134-8998-065e062e2e5e-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:12:48.416762 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:48.416734 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" Jul 21 16:12:48.416939 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:48.416770 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-40a33d-djwgw" event={"ID":"5f807095-f2eb-4134-8998-065e062e2e5e","Type":"ContainerDied","Data":"927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a"} Jul 21 16:12:48.416939 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:48.416841 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="927aefce3b2be670ad36703042accc4943ab4a538b602e0b76c2f0a816e56e4a" Jul 21 16:12:53.339319 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:53.339281 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:53.439662 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:53.439625 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:55.182955 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:55.182919 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:55.284026 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:55.283994 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:12:55.439862 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:12:55.439784 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:13:57.337555 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:13:57.337519 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:13:57.438341 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:13:57.438304 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:13:59.721120 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:13:59.721085 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:14:02.571429 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:14:02.571389 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:14:02.669668 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:14:02.669642 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:14:37.805028 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:14:37.804934 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:14:37.822710 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:14:37.822686 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:15:00.140928 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.140893 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6"] Jul 21 16:15:00.141493 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.141325 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f807095-f2eb-4134-8998-065e062e2e5e" containerName="revoke-keys" Jul 21 16:15:00.141493 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.141343 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f807095-f2eb-4134-8998-065e062e2e5e" containerName="revoke-keys" Jul 21 16:15:00.141493 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.141406 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f807095-f2eb-4134-8998-065e062e2e5e" containerName="revoke-keys" Jul 21 16:15:00.144419 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.144400 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" Jul 21 16:15:00.144612 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.144591 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz"] Jul 21 16:15:00.146712 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.146692 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:15:00.147835 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.147813 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" Jul 21 16:15:00.161663 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.161637 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz"] Jul 21 16:15:00.162667 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.162650 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" Jul 21 16:15:00.164731 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.164636 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6"] Jul 21 16:15:00.171407 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.171376 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" Jul 21 16:15:00.317276 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.317248 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6"] Jul 21 16:15:00.319553 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:15:00.319527 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e25a4a_b893_4338_9e45_7e3d4f38bc72.slice/crio-bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9 WatchSource:0}: Error finding container bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9: Status 404 returned error can't find the container with id bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9 Jul 21 16:15:00.340576 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:00.340549 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz"] Jul 21 16:15:00.341127 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:15:00.341100 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4216afe0_5d10_4b93_9a13_f647e97946a4.slice/crio-1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57 WatchSource:0}: Error finding container 1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57: Status 404 returned error can't find the container with id 1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57 Jul 21 16:15:01.074119 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.074083 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" event={"ID":"25e25a4a-b893-4338-9e45-7e3d4f38bc72","Type":"ContainerStarted","Data":"b75fc265d27f0bdfbc129a9f79def931f6e4323251e3fc3897089296d30b4add"} Jul 21 16:15:01.074342 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.074142 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" event={"ID":"25e25a4a-b893-4338-9e45-7e3d4f38bc72","Type":"ContainerStarted","Data":"bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9"} Jul 21 16:15:01.075604 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.075579 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" event={"ID":"4216afe0-5d10-4b93-9a13-f647e97946a4","Type":"ContainerStarted","Data":"56489ac6d6b9dd974c8eb0a4b85826bbc8565fff196cbcd7aefc575288f0b110"} Jul 21 16:15:01.075751 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.075619 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" event={"ID":"4216afe0-5d10-4b93-9a13-f647e97946a4","Type":"ContainerStarted","Data":"1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57"} Jul 21 16:15:01.089214 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.089174 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" podStartSLOduration=1.089140406 podStartE2EDuration="1.089140406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:15:01.087627365 +0000 UTC m=+4524.089881749" watchObservedRunningTime="2026-07-21 16:15:01.089140406 +0000 UTC m=+4524.091394793" Jul 21 16:15:01.100674 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:01.100627 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" podStartSLOduration=1.100613325 podStartE2EDuration="1.100613325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:15:01.100205008 +0000 UTC m=+4524.102459398" watchObservedRunningTime="2026-07-21 16:15:01.100613325 +0000 UTC m=+4524.102867726" Jul 21 16:15:02.082599 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:02.082560 2585 generic.go:356] "Generic (PLEG): container finished" podID="4216afe0-5d10-4b93-9a13-f647e97946a4" containerID="56489ac6d6b9dd974c8eb0a4b85826bbc8565fff196cbcd7aefc575288f0b110" exitCode=0 Jul 21 16:15:02.083023 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:02.082652 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" event={"ID":"4216afe0-5d10-4b93-9a13-f647e97946a4","Type":"ContainerDied","Data":"56489ac6d6b9dd974c8eb0a4b85826bbc8565fff196cbcd7aefc575288f0b110"} Jul 21 16:15:02.084128 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:02.084107 2585 generic.go:356] "Generic (PLEG): container finished" podID="25e25a4a-b893-4338-9e45-7e3d4f38bc72" containerID="b75fc265d27f0bdfbc129a9f79def931f6e4323251e3fc3897089296d30b4add" exitCode=0 Jul 21 16:15:02.084236 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:02.084134 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" event={"ID":"25e25a4a-b893-4338-9e45-7e3d4f38bc72","Type":"ContainerDied","Data":"b75fc265d27f0bdfbc129a9f79def931f6e4323251e3fc3897089296d30b4add"} Jul 21 16:15:03.219947 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:03.219922 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" Jul 21 16:15:03.246897 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:03.246875 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" Jul 21 16:15:04.094886 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.094847 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" Jul 21 16:15:04.095066 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.094846 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6" event={"ID":"25e25a4a-b893-4338-9e45-7e3d4f38bc72","Type":"ContainerDied","Data":"bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9"} Jul 21 16:15:04.095066 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.094967 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd94d170ff42d6ae55d9c8ee63a7ec5f9f97ed90027dd157b2a5f7aed79b6cb9" Jul 21 16:15:04.096246 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.096229 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" Jul 21 16:15:04.096357 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.096231 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744175-msmzz" event={"ID":"4216afe0-5d10-4b93-9a13-f647e97946a4","Type":"ContainerDied","Data":"1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57"} Jul 21 16:15:04.096425 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.096366 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e0f61ee62511616a66fc70adc0bce4d7bd9913092f04b0c9696d8ea577bba57" Jul 21 16:15:04.282263 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.282234 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h"] Jul 21 16:15:04.287211 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:04.287186 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-kpr5h"] Jul 21 16:15:05.554084 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:05.554050 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8b0945a-c3da-4d5e-9c05-bacc1a1c9534" path="/var/lib/kubelet/pods/a8b0945a-c3da-4d5e-9c05-bacc1a1c9534/volumes" Jul 21 16:15:08.297851 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:08.297808 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:37.881865 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:37.881835 2585 scope.go:117] "RemoveContainer" containerID="054623d16508c5fdb324bf1d48e0ebea8bdf5c8bf5a38a810ae75bfbab5582f2" Jul 21 16:15:45.048418 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:45.048389 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:50.924834 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:50.924793 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:50.988922 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:50.988891 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:51.201672 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.201572 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:51.435879 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.435846 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:51.554282 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554203 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52"] Jul 21 16:15:51.554537 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554525 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4216afe0-5d10-4b93-9a13-f647e97946a4" containerName="cleanup" Jul 21 16:15:51.554579 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554539 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4216afe0-5d10-4b93-9a13-f647e97946a4" containerName="cleanup" Jul 21 16:15:51.554579 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554547 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e25a4a-b893-4338-9e45-7e3d4f38bc72" containerName="cleanup" Jul 21 16:15:51.554579 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554553 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e25a4a-b893-4338-9e45-7e3d4f38bc72" containerName="cleanup" Jul 21 16:15:51.554669 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554619 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4216afe0-5d10-4b93-9a13-f647e97946a4" containerName="cleanup" Jul 21 16:15:51.554669 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.554631 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e25a4a-b893-4338-9e45-7e3d4f38bc72" containerName="cleanup" Jul 21 16:15:51.558948 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.558933 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:51.562538 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.562508 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:15:51.562682 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.562523 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:15:51.564657 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.564633 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52"] Jul 21 16:15:51.649561 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.649519 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52\" (UID: \"19557fe0-0e41-4ae1-955e-800b4e2243a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:51.750341 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.750298 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52\" (UID: \"19557fe0-0e41-4ae1-955e-800b4e2243a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:51.750937 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.750916 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52\" (UID: \"19557fe0-0e41-4ae1-955e-800b4e2243a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:51.870414 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:51.870381 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:52.013564 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.013535 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52"] Jul 21 16:15:52.015116 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:15:52.015082 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19557fe0_0e41_4ae1_955e_800b4e2243a3.slice/crio-414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292 WatchSource:0}: Error finding container 414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292: Status 404 returned error can't find the container with id 414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292 Jul 21 16:15:52.107562 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.107535 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:52.202773 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.202744 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:15:52.338432 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.338400 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" event={"ID":"19557fe0-0e41-4ae1-955e-800b4e2243a3","Type":"ContainerStarted","Data":"28757b528cae48aa5a151086a847f65db8d136f341100a8bd4c3c0021afbfdfa"} Jul 21 16:15:52.338619 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.338448 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" event={"ID":"19557fe0-0e41-4ae1-955e-800b4e2243a3","Type":"ContainerStarted","Data":"414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292"} Jul 21 16:15:52.356739 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:52.356682 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" podStartSLOduration=1.356666937 podStartE2EDuration="1.356666937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:15:52.354575059 +0000 UTC m=+4575.356829460" watchObservedRunningTime="2026-07-21 16:15:52.356666937 +0000 UTC m=+4575.358921377" Jul 21 16:15:53.344757 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:53.344720 2585 generic.go:356] "Generic (PLEG): container finished" podID="19557fe0-0e41-4ae1-955e-800b4e2243a3" containerID="28757b528cae48aa5a151086a847f65db8d136f341100a8bd4c3c0021afbfdfa" exitCode=0 Jul 21 16:15:53.345163 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:53.344799 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" event={"ID":"19557fe0-0e41-4ae1-955e-800b4e2243a3","Type":"ContainerDied","Data":"28757b528cae48aa5a151086a847f65db8d136f341100a8bd4c3c0021afbfdfa"} Jul 21 16:15:54.484043 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:54.484016 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:54.578620 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:54.578580 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca\") pod \"19557fe0-0e41-4ae1-955e-800b4e2243a3\" (UID: \"19557fe0-0e41-4ae1-955e-800b4e2243a3\") " Jul 21 16:15:54.578951 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:54.578927 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19557fe0-0e41-4ae1-955e-800b4e2243a3" (UID: "19557fe0-0e41-4ae1-955e-800b4e2243a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:15:54.680037 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:54.679943 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19557fe0-0e41-4ae1-955e-800b4e2243a3-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:15:55.355370 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:55.355339 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" Jul 21 16:15:55.355574 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:55.355386 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52" event={"ID":"19557fe0-0e41-4ae1-955e-800b4e2243a3","Type":"ContainerDied","Data":"414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292"} Jul 21 16:15:55.355574 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:55.355432 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="414cfe16bbce7fc4be4f4955df51e75825422fb115309553ea70fa2838fb6292" Jul 21 16:15:57.052445 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:15:57.052414 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:16:02.202904 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:16:02.202818 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:16:02.208407 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:16:02.208381 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6"] Jul 21 16:16:02.213162 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:16:02.213124 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb94bd-29744175-tztd6"] Jul 21 16:16:03.554521 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:16:03.554490 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e25a4a-b893-4338-9e45-7e3d4f38bc72" path="/var/lib/kubelet/pods/25e25a4a-b893-4338-9e45-7e3d4f38bc72/volumes" Jul 21 16:18:07.278300 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:07.278251 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:07.334507 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:07.334469 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:51.918597 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:51.918567 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:57.618981 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:57.618893 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:57.685279 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:57.685245 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:58.151371 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:58.151340 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:58.251973 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:58.251942 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:58.534308 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:58.534213 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:58.902272 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:58.902243 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:18:59.099557 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:18:59.099518 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:01.992994 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:01.992954 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:02.080320 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:02.080290 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:02.145968 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:02.145942 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:02.489576 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:02.489537 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:02.856896 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:02.856865 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:02.956924 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:02.956892 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:03.744518 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:03.744481 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:03.844695 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:03.844660 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:04.560070 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:04.560046 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:04.658555 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:04.658523 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:06.488594 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:06.488565 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:06.883275 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:06.883245 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:07.204629 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:07.204553 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:07.442867 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:07.442834 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.051168 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.051084 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.188528 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.188497 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.341911 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.341829 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.435771 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.435736 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.812201 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.812168 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:10.914826 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:10.914785 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:14.567878 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:14.567847 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:23.648565 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:23.648527 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:23.758521 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:23.758491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:28.099512 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:28.099479 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:32.719488 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:32.719450 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:32.819645 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:32.819612 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:33.004086 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:33.003996 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:19:37.835406 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:37.835305 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:19:37.854348 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:19:37.854327 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:20:11.780817 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:11.780773 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:20:55.733953 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:55.733921 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:20:56.666829 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.666793 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:20:56.733622 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.733589 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd"] Jul 21 16:20:56.733949 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.733937 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19557fe0-0e41-4ae1-955e-800b4e2243a3" containerName="revoke-keys" Jul 21 16:20:56.733992 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.733951 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="19557fe0-0e41-4ae1-955e-800b4e2243a3" containerName="revoke-keys" Jul 21 16:20:56.734270 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.734009 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="19557fe0-0e41-4ae1-955e-800b4e2243a3" containerName="revoke-keys" Jul 21 16:20:56.737235 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.737219 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:20:56.740707 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.740681 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:20:56.740833 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.740743 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:20:56.748290 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.748267 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd"] Jul 21 16:20:56.868304 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.868275 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd\" (UID: \"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:20:56.969115 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.969019 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd\" (UID: \"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:20:56.969661 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:56.969639 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd\" (UID: \"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:20:57.047043 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.047001 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:20:57.181120 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.181097 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd"] Jul 21 16:20:57.183541 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:20:57.183512 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24c6f8f_d8a2_4543_bfd9_71d5a98d614a.slice/crio-cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab WatchSource:0}: Error finding container cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab: Status 404 returned error can't find the container with id cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab Jul 21 16:20:57.541466 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.541422 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:20:57.652967 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.652856 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:20:57.876535 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.876506 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" event={"ID":"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a","Type":"ContainerStarted","Data":"362e402c4127ed1a199a182af94313da4e3cb8c7a7affffa562f336931092579"} Jul 21 16:20:57.876935 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.876573 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" event={"ID":"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a","Type":"ContainerStarted","Data":"cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab"} Jul 21 16:20:57.913318 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:57.913201 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" podStartSLOduration=1.91317996 podStartE2EDuration="1.91317996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:20:57.911900227 +0000 UTC m=+4880.914154616" watchObservedRunningTime="2026-07-21 16:20:57.91317996 +0000 UTC m=+4880.915434359" Jul 21 16:20:58.883179 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:58.883124 2585 generic.go:356] "Generic (PLEG): container finished" podID="e24c6f8f-d8a2-4543-bfd9-71d5a98d614a" containerID="362e402c4127ed1a199a182af94313da4e3cb8c7a7affffa562f336931092579" exitCode=0 Jul 21 16:20:58.883578 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:20:58.883211 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" event={"ID":"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a","Type":"ContainerDied","Data":"362e402c4127ed1a199a182af94313da4e3cb8c7a7affffa562f336931092579"} Jul 21 16:21:00.015473 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.015445 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:21:00.101645 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.101613 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca\") pod \"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a\" (UID: \"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a\") " Jul 21 16:21:00.102004 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.101985 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e24c6f8f-d8a2-4543-bfd9-71d5a98d614a" (UID: "e24c6f8f-d8a2-4543-bfd9-71d5a98d614a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:21:00.203353 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.203270 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e24c6f8f-d8a2-4543-bfd9-71d5a98d614a-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:21:00.893649 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.893619 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" Jul 21 16:21:00.893846 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.893658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd" event={"ID":"e24c6f8f-d8a2-4543-bfd9-71d5a98d614a","Type":"ContainerDied","Data":"cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab"} Jul 21 16:21:00.893846 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:00.893706 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf169398204702ffbdcfe66c3d8988c88d81a6f829807768d14d63484608e3ab" Jul 21 16:21:07.297948 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:07.297913 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:21:37.945509 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:37.945477 2585 scope.go:117] "RemoveContainer" containerID="b75fc265d27f0bdfbc129a9f79def931f6e4323251e3fc3897089296d30b4add" Jul 21 16:21:45.875759 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:45.875714 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:21:45.939555 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:21:45.939523 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:22:42.893965 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:22:42.893931 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:23:57.770041 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:23:57.770010 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:03.304350 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.304313 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:03.381973 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.381936 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:03.604217 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.604178 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:03.809624 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.809580 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:03.927559 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.927477 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d"] Jul 21 16:24:03.927836 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.927824 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24c6f8f-d8a2-4543-bfd9-71d5a98d614a" containerName="revoke-keys" Jul 21 16:24:03.927881 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.927837 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24c6f8f-d8a2-4543-bfd9-71d5a98d614a" containerName="revoke-keys" Jul 21 16:24:03.927916 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.927894 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24c6f8f-d8a2-4543-bfd9-71d5a98d614a" containerName="revoke-keys" Jul 21 16:24:03.930838 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.930821 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:03.933306 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.933285 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\"" Jul 21 16:24:03.933420 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.933286 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 16:24:03.939431 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:03.939398 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d"] Jul 21 16:24:04.031229 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.031198 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d\" (UID: \"1912821b-2996-46a1-8b53-64d78242ecfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:04.132201 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.132169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d\" (UID: \"1912821b-2996-46a1-8b53-64d78242ecfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:04.132844 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.132823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d\" (UID: \"1912821b-2996-46a1-8b53-64d78242ecfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:04.242307 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.242221 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:04.375367 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.375344 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d"] Jul 21 16:24:04.376986 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:24:04.376959 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1912821b_2996_46a1_8b53_64d78242ecfc.slice/crio-e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6 WatchSource:0}: Error finding container e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6: Status 404 returned error can't find the container with id e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6 Jul 21 16:24:04.470497 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.470466 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:04.580502 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.580420 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:04.843807 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.843713 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" event={"ID":"1912821b-2996-46a1-8b53-64d78242ecfc","Type":"ContainerStarted","Data":"7e119faeb606601f9034f3b8c8958764a1b1979c1c08811a918fc35e4aa5a7f3"} Jul 21 16:24:04.843807 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.843769 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" event={"ID":"1912821b-2996-46a1-8b53-64d78242ecfc","Type":"ContainerStarted","Data":"e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6"} Jul 21 16:24:04.876733 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:04.876680 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" podStartSLOduration=1.876666416 podStartE2EDuration="1.876666416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:04.875121578 +0000 UTC m=+5067.877375966" watchObservedRunningTime="2026-07-21 16:24:04.876666416 +0000 UTC m=+5067.878920803" Jul 21 16:24:05.299728 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:05.299694 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:05.406219 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:05.406181 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:05.850451 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:05.850418 2585 generic.go:356] "Generic (PLEG): container finished" podID="1912821b-2996-46a1-8b53-64d78242ecfc" containerID="7e119faeb606601f9034f3b8c8958764a1b1979c1c08811a918fc35e4aa5a7f3" exitCode=0 Jul 21 16:24:05.850630 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:05.850501 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" event={"ID":"1912821b-2996-46a1-8b53-64d78242ecfc","Type":"ContainerDied","Data":"7e119faeb606601f9034f3b8c8958764a1b1979c1c08811a918fc35e4aa5a7f3"} Jul 21 16:24:06.466398 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:06.466357 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:06.566503 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:06.566474 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:06.990051 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:06.990026 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:07.063807 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.063776 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca\") pod \"1912821b-2996-46a1-8b53-64d78242ecfc\" (UID: \"1912821b-2996-46a1-8b53-64d78242ecfc\") " Jul 21 16:24:07.064117 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.064095 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1912821b-2996-46a1-8b53-64d78242ecfc" (UID: "1912821b-2996-46a1-8b53-64d78242ecfc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 16:24:07.164639 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.164561 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1912821b-2996-46a1-8b53-64d78242ecfc-maas-api-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 21 16:24:07.868606 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.868579 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" Jul 21 16:24:07.868985 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.868613 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d" event={"ID":"1912821b-2996-46a1-8b53-64d78242ecfc","Type":"ContainerDied","Data":"e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6"} Jul 21 16:24:07.868985 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:07.868664 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3254deb04b0a03f6c86697ada989b22c632dff4a53c1b8716240e31b56badd6" Jul 21 16:24:14.406452 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:14.406423 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:25.605197 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:25.605136 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:24:37.869415 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:37.869386 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:24:37.887916 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:24:37.887896 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wzkb_f5a674ac-0885-4138-baca-c274f4f7b94e/ovn-acl-logging/0.log" Jul 21 16:26:12.734077 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:26:12.734035 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:04.479416 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:04.479380 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:10.178444 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:10.178407 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:10.280516 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:10.280459 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:10.544687 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:10.544600 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:10.721819 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:10.721772 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:17.095858 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:17.095829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k8g75_5df1c63f-4331-4939-a3a9-87fe64f4c8f4/server/0.log" Jul 21 16:27:17.443891 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:17.443833 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-jrhxq_98314bc1-f739-40ec-ba41-3cd4e7dd2fa7/copy-manifests/0.log" Jul 21 16:27:17.450801 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:17.450777 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-jrhxq_98314bc1-f739-40ec-ba41-3cd4e7dd2fa7/manager/0.log" Jul 21 16:27:18.067658 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.067627 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744145-7wwdk_c4961e6b-eaeb-4c11-8a39-62eef1808df5/cleanup/0.log" Jul 21 16:27:18.183624 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.183595 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744160-v846f_9fc12697-8abc-4d02-9f71-dfcaf9064e50/cleanup/0.log" Jul 21 16:27:18.302541 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.302512 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744175-msmzz_4216afe0-5d10-4b93-9a13-f647e97946a4/cleanup/0.log" Jul 21 16:27:18.452524 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.452493 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-81110a4b-qw9lv_f16216d2-e0d5-496b-b5eb-2adc8a57cd1a/revoke-keys/0.log" Jul 21 16:27:18.581468 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.581436 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-ed4302cf-f4fc5_ea76ba51-9e1e-4dcb-8849-8b7cdef3feb3/revoke-keys/0.log" Jul 21 16:27:18.701199 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.701166 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-40a33d-djwgw_5f807095-f2eb-4134-8998-065e062e2e5e/revoke-keys/0.log" Jul 21 16:27:18.831109 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.831019 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-fb94bd-8fr52_19557fe0-0e41-4ae1-955e-800b4e2243a3/revoke-keys/0.log" Jul 21 16:27:18.953392 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:18.953359 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-5195cc17-sr26w_e464bdab-3103-44c9-aea9-95944fd39287/revoke-keys/0.log" Jul 21 16:27:19.065853 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.065825 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-682cb4-2g24n_2d49fda4-8aab-426a-95c3-df6483f35153/revoke-keys/0.log" Jul 21 16:27:19.196187 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.196136 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-26bb92-7rnq5_98c2e878-d153-4505-8922-e2b9d3ebb5f2/revoke-keys/0.log" Jul 21 16:27:19.307952 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.307914 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-719155ca-2lnhb_c6c19dbf-9b15-41cc-8169-74285f70cd45/revoke-keys/0.log" Jul 21 16:27:19.417527 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.417498 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-534ea2a9-q8dq8_3b7eab0c-613a-409f-990c-1273cb656314/revoke-keys/0.log" Jul 21 16:27:19.531306 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.531215 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-bfbfdffb-qzsnd_5765e483-224f-44d7-b333-54bb29cb7917/revoke-keys/0.log" Jul 21 16:27:19.650876 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.650847 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-524b80-vw7dd_e24c6f8f-d8a2-4543-bfd9-71d5a98d614a/revoke-keys/0.log" Jul 21 16:27:19.766994 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:19.766958 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-bbeb7d-ltl8d_1912821b-2996-46a1-8b53-64d78242ecfc/revoke-keys/0.log" Jul 21 16:27:21.881681 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:21.881650 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6rjzr_c9b41a84-a5fa-41db-b4c6-3f1f4834ddff/discovery/0.log" Jul 21 16:27:23.886217 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:23.886184 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bgcnn_63c693ed-6bc9-4e51-91f9-0a506ab6f600/main/0.log" Jul 21 16:27:24.001433 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:24.001402 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-68hwr_08903c86-d49c-40df-94e5-1205f3521926/main/0.log" Jul 21 16:27:24.113278 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:24.113248 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzvwf_8dcf2769-219e-4052-9ee5-028c77b099e1/main/0.log" Jul 21 16:27:33.802945 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:33.802903 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:33.895104 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:33.895066 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" limit=1024 Jul 21 16:27:36.765752 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:36.765718 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2x2bm_92ad084b-b180-4f42-b401-785ee1b6b965/global-pull-secret-syncer/0.log" Jul 21 16:27:36.910973 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:36.910940 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5t6sc_707069d9-bb46-4bd3-b971-7ad258eb89bc/konnectivity-agent/0.log" Jul 21 16:27:37.031363 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:37.031284 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-25.ec2.internal_d26be7d37844b0dd9eb51bca7acab6c5/haproxy/0.log" Jul 21 16:27:43.613092 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.613056 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/alertmanager/0.log" Jul 21 16:27:43.633778 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.633747 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/config-reloader/0.log" Jul 21 16:27:43.655764 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.655727 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/kube-rbac-proxy-web/0.log" Jul 21 16:27:43.683436 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.683407 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/kube-rbac-proxy/0.log" Jul 21 16:27:43.707357 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.707330 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/kube-rbac-proxy-metric/0.log" Jul 21 16:27:43.734194 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.734166 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/prom-label-proxy/0.log" Jul 21 16:27:43.752008 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.751981 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ecea86-8251-464e-9355-4682ef5c5d1d/init-config-reloader/0.log" Jul 21 16:27:43.834370 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.834339 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r6t2b_a2fc2ef9-e4d1-4381-9407-2049cbab9f85/kube-state-metrics/0.log" Jul 21 16:27:43.851955 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.851931 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r6t2b_a2fc2ef9-e4d1-4381-9407-2049cbab9f85/kube-rbac-proxy-main/0.log" Jul 21 16:27:43.870885 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.870812 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r6t2b_a2fc2ef9-e4d1-4381-9407-2049cbab9f85/kube-rbac-proxy-self/0.log" Jul 21 16:27:43.898642 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:43.898617 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5db946b6d6-mzcp2_3141b1d7-eb10-4f26-b5fe-a4947b90cc17/metrics-server/0.log" Jul 21 16:27:44.126832 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.126756 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vdcrm_b4e69a01-5838-4006-9c5b-6a83a3479212/node-exporter/0.log" Jul 21 16:27:44.143715 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.143690 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vdcrm_b4e69a01-5838-4006-9c5b-6a83a3479212/kube-rbac-proxy/0.log" Jul 21 16:27:44.161509 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.161488 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vdcrm_b4e69a01-5838-4006-9c5b-6a83a3479212/init-textfile/0.log" Jul 21 16:27:44.188460 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.188432 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78ggc_ce931326-b4d4-462a-ae6c-aee202277fee/kube-rbac-proxy-main/0.log" Jul 21 16:27:44.206786 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.206761 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78ggc_ce931326-b4d4-462a-ae6c-aee202277fee/kube-rbac-proxy-self/0.log" Jul 21 16:27:44.227250 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.227221 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-78ggc_ce931326-b4d4-462a-ae6c-aee202277fee/openshift-state-metrics/0.log" Jul 21 16:27:44.560309 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.560286 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f785c84f-2lrml_a6cda195-0811-4443-9d12-db50e75f8b69/telemeter-client/0.log" Jul 21 16:27:44.597434 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.597409 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f785c84f-2lrml_a6cda195-0811-4443-9d12-db50e75f8b69/reload/0.log" Jul 21 16:27:44.620461 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:44.620437 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f785c84f-2lrml_a6cda195-0811-4443-9d12-db50e75f8b69/kube-rbac-proxy/0.log" Jul 21 16:27:47.533570 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.533531 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w"] Jul 21 16:27:47.534122 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.534071 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1912821b-2996-46a1-8b53-64d78242ecfc" containerName="revoke-keys" Jul 21 16:27:47.534122 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.534091 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1912821b-2996-46a1-8b53-64d78242ecfc" containerName="revoke-keys" Jul 21 16:27:47.534301 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.534203 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1912821b-2996-46a1-8b53-64d78242ecfc" containerName="revoke-keys" Jul 21 16:27:47.537532 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.537513 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.540054 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.540034 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5nz6r\"/\"default-dockercfg-zjl95\"" Jul 21 16:27:47.540370 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.540352 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5nz6r\"/\"openshift-service-ca.crt\"" Jul 21 16:27:47.541085 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.541063 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5nz6r\"/\"kube-root-ca.crt\"" Jul 21 16:27:47.555587 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.555560 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w"] Jul 21 16:27:47.590217 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.590189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-lib-modules\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.590217 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.590223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-podres\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.590456 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.590256 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-sys\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.590456 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.590372 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcl7\" (UniqueName: \"kubernetes.io/projected/cb165a84-af89-49d5-b7c3-79093270b5af-kube-api-access-fwcl7\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.590456 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.590422 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-proc\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691703 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691662 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-lib-modules\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691703 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691706 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-podres\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691954 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691830 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-podres\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691954 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691834 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-lib-modules\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691954 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-sys\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.691954 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691885 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-sys\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.692200 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.691986 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcl7\" (UniqueName: \"kubernetes.io/projected/cb165a84-af89-49d5-b7c3-79093270b5af-kube-api-access-fwcl7\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.692200 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.692047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-proc\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.692200 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.692141 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb165a84-af89-49d5-b7c3-79093270b5af-proc\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.700262 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.700241 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcl7\" (UniqueName: \"kubernetes.io/projected/cb165a84-af89-49d5-b7c3-79093270b5af-kube-api-access-fwcl7\") pod \"perf-node-gather-daemonset-4vg9w\" (UID: \"cb165a84-af89-49d5-b7c3-79093270b5af\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.847573 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.847547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:47.986188 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:47.986163 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w"] Jul 21 16:27:47.988811 ip-10-0-129-25 kubenswrapper[2585]: W0721 16:27:47.988788 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb165a84_af89_49d5_b7c3_79093270b5af.slice/crio-66930a04529104c98fe2b5602a44146da0dcbd579b5e8ed2649092d4e9872adb WatchSource:0}: Error finding container 66930a04529104c98fe2b5602a44146da0dcbd579b5e8ed2649092d4e9872adb: Status 404 returned error can't find the container with id 66930a04529104c98fe2b5602a44146da0dcbd579b5e8ed2649092d4e9872adb Jul 21 16:27:48.993386 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:48.993350 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" event={"ID":"cb165a84-af89-49d5-b7c3-79093270b5af","Type":"ContainerStarted","Data":"2bf6c894a01dec48bb0812b1867678ed5730bf42627ded8ee109d416c2c19d1d"} Jul 21 16:27:48.993779 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:48.993400 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" event={"ID":"cb165a84-af89-49d5-b7c3-79093270b5af","Type":"ContainerStarted","Data":"66930a04529104c98fe2b5602a44146da0dcbd579b5e8ed2649092d4e9872adb"} Jul 21 16:27:48.993779 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:48.993426 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:49.010322 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:49.010274 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" podStartSLOduration=2.010255886 podStartE2EDuration="2.010255886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:49.009267189 +0000 UTC m=+5292.011521577" watchObservedRunningTime="2026-07-21 16:27:49.010255886 +0000 UTC m=+5292.012510276" Jul 21 16:27:49.454763 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:49.454738 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sclfg_910bcdf3-7232-4eba-b6da-07c0d3925ef9/dns/0.log" Jul 21 16:27:49.481208 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:49.481178 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sclfg_910bcdf3-7232-4eba-b6da-07c0d3925ef9/kube-rbac-proxy/0.log" Jul 21 16:27:49.530833 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:49.530805 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h54f7_c68ffdc1-d2af-4ab9-bd1b-50458cb0287a/dns-node-resolver/0.log" Jul 21 16:27:50.171207 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:50.171174 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7884d9875b-ncdcg_7826ceb6-5e10-48cc-8d1c-5dc16c0281fa/registry/0.log" Jul 21 16:27:50.198992 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:50.198957 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-875xh_29ffa9eb-a8ab-4500-a6d7-2b2958b12da4/node-ca/0.log" Jul 21 16:27:51.409498 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:51.409459 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6rjzr_c9b41a84-a5fa-41db-b4c6-3f1f4834ddff/discovery/0.log" Jul 21 16:27:52.277762 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:52.277734 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xfx8_f980dc71-0dbc-49a1-8543-bde8f8fb8fb5/serve-healthcheck-canary/0.log" Jul 21 16:27:52.912459 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:52.912423 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvh7z_471ed043-840d-4c11-ad12-7908e9b7b6de/kube-rbac-proxy/0.log" Jul 21 16:27:52.937959 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:52.937932 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvh7z_471ed043-840d-4c11-ad12-7908e9b7b6de/exporter/0.log" Jul 21 16:27:52.963428 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:52.963400 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvh7z_471ed043-840d-4c11-ad12-7908e9b7b6de/extractor/0.log" Jul 21 16:27:55.011028 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:55.011000 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-4vg9w" Jul 21 16:27:55.569355 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:55.569327 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k8g75_5df1c63f-4331-4939-a3a9-87fe64f4c8f4/server/0.log" Jul 21 16:27:55.751927 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:55.751898 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-jrhxq_98314bc1-f739-40ec-ba41-3cd4e7dd2fa7/manager/0.log" Jul 21 16:27:55.772274 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:55.772256 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-jrhxq_98314bc1-f739-40ec-ba41-3cd4e7dd2fa7/copy-manifests/0.log" Jul 21 16:27:57.375334 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:57.375300 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c4b7cdb88-942vd_dd8dce6e-b44e-49d3-a09d-867f308d2035/manager/0.log" Jul 21 16:27:58.083379 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:58.083284 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6rjzr_c9b41a84-a5fa-41db-b4c6-3f1f4834ddff/discovery/0.log" Jul 21 16:27:59.663586 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:27:59.663553 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6rjzr_c9b41a84-a5fa-41db-b4c6-3f1f4834ddff/discovery/0.log" Jul 21 16:28:04.062365 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.062333 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4tkxr_deab3fe1-8dc2-4ff5-bbde-ffa46c89dfbd/kube-multus/0.log" Jul 21 16:28:04.427383 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.427354 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/kube-multus-additional-cni-plugins/0.log" Jul 21 16:28:04.446746 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.446722 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/egress-router-binary-copy/0.log" Jul 21 16:28:04.470406 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.470373 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/cni-plugins/0.log" Jul 21 16:28:04.492697 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.492672 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/bond-cni-plugin/0.log" Jul 21 16:28:04.520854 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.520829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/routeoverride-cni/0.log" Jul 21 16:28:04.542563 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.542546 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/whereabouts-cni-bincopy/0.log" Jul 21 16:28:04.564789 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.564768 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm8wg_03ed4b0b-5b21-46f3-af53-e2a25411b977/whereabouts-cni/0.log" Jul 21 16:28:04.739603 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.739522 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kvkmn_8529b685-aecf-4eeb-a3cd-538037c7732e/network-metrics-daemon/0.log" Jul 21 16:28:04.762107 ip-10-0-129-25 kubenswrapper[2585]: I0721 16:28:04.762074 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kvkmn_8529b685-aecf-4eeb-a3cd-538037c7732e/kube-rbac-proxy/0.log"