Jul 09 17:37:14.580608 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 17:37:14.580624 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 17:37:14.580634 ip-10-0-135-252 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 17:37:14.580980 ip-10-0-135-252 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 17:37:24.590948 ip-10-0-135-252 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 17:37:24.590974 ip-10-0-135-252 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1d91e6f0e6a34390802333f4fa0cf2c9 -- Jul 09 17:39:26.131498 ip-10-0-135-252 systemd[1]: Starting Kubernetes Kubelet... Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.577813 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583305 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583322 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583326 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583330 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583333 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583336 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583339 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.609809 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583342 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583345 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583349 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583352 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583355 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583358 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583361 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583364 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583368 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583371 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583373 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583376 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583379 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583382 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583385 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583387 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583390 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583393 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583396 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.610705 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583399 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583402 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583405 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583409 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583414 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583418 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583421 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583424 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583428 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583431 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583434 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583438 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583442 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583445 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583448 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583452 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583454 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583457 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583460 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.611373 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583463 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583466 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583469 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583472 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583474 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583479 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583481 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583484 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583486 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583490 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583493 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583496 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583499 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583502 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583505 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583510 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583513 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583516 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583519 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583522 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.612062 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583525 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583528 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583532 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583534 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583537 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583540 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583544 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583547 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583550 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583552 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583555 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583558 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583560 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583563 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583566 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583568 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583571 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583574 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583577 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583580 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.612763 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583583 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583586 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583589 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583591 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583595 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583598 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583601 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583604 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583606 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583609 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583613 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583618 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583621 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.583623 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584427 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584434 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584438 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584441 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584445 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584449 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.613472 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584452 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584455 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584458 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584461 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584464 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584467 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584470 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584472 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584475 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584478 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584480 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584483 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584486 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584489 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584492 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584494 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584498 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584501 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584504 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584507 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.614137 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584509 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584512 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584515 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584518 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584521 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584523 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584526 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584529 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584533 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584537 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584541 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584544 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584548 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584551 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584554 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584556 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584559 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584562 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584564 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584567 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.614822 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584570 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584572 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584576 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584579 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584581 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584584 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584587 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584590 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584594 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584597 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584599 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584602 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584605 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584608 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584611 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584617 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584621 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584624 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584627 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584630 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.615501 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584633 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584636 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584638 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584641 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584644 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584648 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584650 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584653 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584656 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584658 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584662 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584664 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584667 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584669 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584672 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584674 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584677 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584680 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584683 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.616531 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584686 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584689 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584692 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584695 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584698 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584701 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584704 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584708 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584712 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584715 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584718 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584721 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584725 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.584728 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585136 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585141 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585144 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585147 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585153 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.617107 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585157 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585161 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585164 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585168 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585171 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585174 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585177 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585179 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585183 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585187 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585191 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585194 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585197 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585200 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585205 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585208 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585210 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585213 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585216 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585219 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.766900 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585221 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.675336 ip-10-0-135-252 systemd[1]: Started Kubernetes Kubelet. Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585224 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585227 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585230 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585233 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585236 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585238 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585241 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585261 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585265 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585271 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585274 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585278 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585281 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585284 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585287 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585289 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585292 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585295 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.767880 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585298 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585301 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585304 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585306 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585309 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585312 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585315 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585318 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585321 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585324 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585327 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585330 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585333 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585336 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585339 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585341 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585344 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585347 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585349 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585352 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.768779 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585355 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585358 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585360 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585364 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585367 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585370 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585373 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585376 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585379 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585382 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585384 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585387 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585390 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585393 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585398 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585401 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585404 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585407 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585410 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585413 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.769665 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585416 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585419 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585422 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585425 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585428 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585431 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585435 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585438 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585441 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585444 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585446 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585449 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585452 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585455 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.585457 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585534 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585548 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585555 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585559 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585565 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585568 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 17:39:26.770413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585573 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585578 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585581 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585584 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585588 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585592 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585595 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585598 2557 flags.go:64] FLAG: --cgroup-root="" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585601 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585604 2557 flags.go:64] FLAG: --client-ca-file="" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585608 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585611 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585616 2557 flags.go:64] FLAG: --cluster-domain="" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585619 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585623 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585627 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585630 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585636 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585639 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585643 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585646 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585650 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585653 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585656 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 17:39:26.771080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585660 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585663 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585669 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585673 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585676 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585691 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585695 2557 flags.go:64] FLAG: --enable-server="true" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585699 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585704 2557 flags.go:64] FLAG: --event-burst="100" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585707 2557 flags.go:64] FLAG: --event-qps="50" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585711 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585714 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585717 2557 flags.go:64] FLAG: --eviction-hard="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585721 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585725 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585728 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585731 2557 flags.go:64] FLAG: --eviction-soft="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585735 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585738 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585741 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585744 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585747 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585751 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585754 2557 flags.go:64] FLAG: --feature-gates="" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585758 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 17:39:26.771818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585763 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585766 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585770 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585773 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585776 2557 flags.go:64] FLAG: --help="false" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585779 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-135-252.ec2.internal" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585783 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585786 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585789 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585794 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585798 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585801 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585804 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585807 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585810 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585814 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585818 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585821 2557 flags.go:64] FLAG: --kube-reserved="" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585824 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585827 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585830 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585833 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585836 2557 flags.go:64] FLAG: --lock-file="" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585839 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 17:39:26.772685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585842 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585846 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585851 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585854 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585857 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585860 2557 flags.go:64] FLAG: --logging-format="text" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585864 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585867 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585872 2557 flags.go:64] FLAG: --manifest-url="" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585875 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585880 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585883 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585887 2557 flags.go:64] FLAG: --max-pods="110" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585890 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585893 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585896 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585900 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585904 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585907 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585910 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585918 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585921 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585924 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 17:39:26.773449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585927 2557 flags.go:64] FLAG: --pod-cidr="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585931 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585937 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585941 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585944 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585947 2557 flags.go:64] FLAG: --port="10250" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585950 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585953 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0726c8074d9d67c17" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585957 2557 flags.go:64] FLAG: --qos-reserved="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585960 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585963 2557 flags.go:64] FLAG: --register-node="true" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585966 2557 flags.go:64] FLAG: --register-with-taints="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585974 2557 flags.go:64] FLAG: --registry-burst="10" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585977 2557 flags.go:64] FLAG: --registry-qps="5" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585980 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585983 2557 flags.go:64] FLAG: --reserved-memory="" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585987 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585991 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585996 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.585999 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586002 2557 flags.go:64] FLAG: --runonce="false" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586005 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586008 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586011 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586015 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 17:39:26.774217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586018 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586022 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586025 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586029 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586032 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586035 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586038 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586042 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586045 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586049 2557 flags.go:64] FLAG: --system-cgroups="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586052 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586058 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586061 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586064 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586069 2557 flags.go:64] FLAG: --tls-min-version="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586072 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586075 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586078 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586081 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586084 2557 flags.go:64] FLAG: --v="2" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586088 2557 flags.go:64] FLAG: --version="false" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586093 2557 flags.go:64] FLAG: --vmodule="" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586097 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586100 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586225 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.775030 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586231 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586234 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586237 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586240 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586258 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586261 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586264 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586267 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586271 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586274 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586277 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586280 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586283 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586287 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586289 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586294 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586298 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586302 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586306 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.776094 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586310 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586313 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586316 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586319 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586322 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586325 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586327 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586330 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586333 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586335 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586338 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586341 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586344 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586348 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586351 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586354 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586359 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586363 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586366 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.777104 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586369 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586372 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586377 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586380 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586383 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586386 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586389 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586392 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586395 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586399 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586403 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586406 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586411 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586414 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586417 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586419 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586422 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586425 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586428 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586431 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.777838 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586433 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586436 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586439 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586441 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586444 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586447 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586451 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586454 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586457 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586460 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586463 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586465 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586468 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586471 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586477 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586480 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586482 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586485 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586488 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586491 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.778462 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586494 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586496 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586499 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586502 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586505 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586508 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586511 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586513 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586516 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586519 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586521 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586524 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586527 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586530 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586532 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586535 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586538 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586541 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586545 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.779131 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.586548 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.586554 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.595038 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.595062 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.595083 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.595089 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595157 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595163 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595166 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595170 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595173 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595177 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595180 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595183 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595186 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.779706 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595189 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595191 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595194 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595204 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595206 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595209 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595212 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595215 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595218 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595221 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595224 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595227 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595230 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595233 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595237 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595240 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595243 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595263 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595267 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595271 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595275 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.780318 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595277 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595281 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595286 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595290 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595293 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595296 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595299 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595302 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595305 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595308 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595310 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595313 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595316 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595319 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595321 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595331 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595334 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595336 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595339 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.781012 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595342 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595345 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595348 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595351 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595354 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595357 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595360 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595363 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595366 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595369 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595371 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595374 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595381 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595384 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595387 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595391 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595395 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595399 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595403 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.781956 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595406 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595410 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595414 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595417 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595420 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595423 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595426 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595429 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595431 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595434 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595445 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595448 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595450 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595453 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595456 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595459 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595462 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595464 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595467 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.785192 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595470 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595473 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595475 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595478 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595481 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595484 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595488 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595491 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595494 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595497 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595500 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595502 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.595508 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595669 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595674 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:39:26.785860 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595678 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595681 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595684 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595686 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595689 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595692 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595695 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595698 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595701 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595712 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595715 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595719 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595721 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595724 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595727 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595730 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595733 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595735 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595738 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595741 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:39:26.960285 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595744 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595747 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595749 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595753 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595756 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595759 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595762 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595764 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595767 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595770 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595772 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595775 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595779 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595783 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595786 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595795 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595799 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595802 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595805 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595809 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:39:26.982753 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595812 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595816 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595825 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595828 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595831 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595834 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595837 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595840 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595843 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595845 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595848 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595851 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595854 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595857 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595859 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595863 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595866 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595869 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595872 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:39:26.983409 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595874 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595877 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595880 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595884 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595888 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595891 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595894 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595897 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595901 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595904 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595907 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595909 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595912 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595915 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595920 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595922 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595933 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595936 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595943 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595946 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:39:26.984047 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595948 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595951 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595953 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595956 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595959 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595962 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595964 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595967 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595972 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595975 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595979 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595982 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595985 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595987 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595990 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595993 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595996 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:39:26.984683 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:26.595998 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.596003 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.596138 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.600306 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.602111 2557 server.go:1019] "Starting client certificate rotation" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.602233 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.602281 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.604921 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.610959 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.622457 2557 log.go:25] "Validated CRI v1 runtime API" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.624563 2557 log.go:25] "Validated CRI v1 image API" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.633461 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 17:39:26.985271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.636363 2557 fs.go:135] Filesystem UUIDs: map[514a1ee5-0cd7-4e5d-b0fc-398e34826ca1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ff835921-2c5b-493c-a30a-bc8a0f4084a2:/dev/nvme0n1p4] Jul 09 17:39:26.985716 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.636383 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.645543 2557 manager.go:216] Machine: {Timestamp:2026-07-09 17:39:26.641803522 +0000 UTC m=+0.387792446 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088454 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20175ef4640d54a1385e83f4fd0714 SystemUUID:ec20175e-f464-0d54-a138-5e83f4fd0714 BootID:1d91e6f0-e6a3-4390-8023-33f4fa0cf2c9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:f3:87:37:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:f3:87:37:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:7e:8e:6c:b2:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.645659 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.645753 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.646536 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.649939 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.649977 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-252.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 17:39:26.985834 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.650743 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.650755 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.650763 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.651534 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.652557 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655513 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655657 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655694 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655704 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655720 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655731 2557 kubelet.go:398] "Adding apiserver pod source" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.655740 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.657156 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.657209 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.665011 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.667287 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.667319 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668675 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668693 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668699 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668706 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668717 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668723 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668732 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668740 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668748 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668755 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668765 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.668770 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.670943 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.670954 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.674411 2557 server.go:1268] "Started kubelet" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.674489 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.674614 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.674510 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.674691 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.674819 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.676547 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.677460 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.681384 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.684573 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 17:39:26.986118 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.684583 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.684652 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685320 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685366 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685322 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685450 2557 factory.go:55] Registering systemd factory Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685467 2557 factory.go:223] Registration of the systemd container factory successfully Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685521 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685532 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685748 2557 factory.go:153] Registering CRI-O factory Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685762 2557 factory.go:223] Registration of the crio container factory successfully Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685807 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685826 2557 factory.go:103] Registering Raw factory Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.685837 2557 manager.go:1196] Started watching for new ooms in manager Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.686302 2557 manager.go:349] Starting recovery of all containers Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.690410 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.690507 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-252.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.690778 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.690662 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-252.ec2.internal.18c0afd17a58b9a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-252.ec2.internal,UID:ip-10-0-135-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-252.ec2.internal,},FirstTimestamp:2026-07-09 17:39:26.674377121 +0000 UTC m=+0.420366045,LastTimestamp:2026-07-09 17:39:26.674377121 +0000 UTC m=+0.420366045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-252.ec2.internal,}" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.705019 2557 manager.go:354] Recovery completed Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.706663 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84wtj" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.709749 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.712616 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.712646 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.712661 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.713382 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.713392 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.713410 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.714755 2557 policy_none.go:49] "None policy: Start" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.714769 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.714782 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.715903 2557 policy_none.go:47] "Start" Jul 09 17:39:26.987482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.716844 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.717392 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-252.ec2.internal.18c0afd17ca07a26 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-252.ec2.internal,UID:ip-10-0-135-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-252.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-252.ec2.internal,},FirstTimestamp:2026-07-09 17:39:26.712633894 +0000 UTC m=+0.458622825,LastTimestamp:2026-07-09 17:39:26.712633894 +0000 UTC m=+0.458622825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-252.ec2.internal,}" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.718340 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.718365 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.718379 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.719013 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84wtj" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775184 2557 manager.go:337] "Starting Device Plugin manager" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.775242 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775257 2557 server.go:87] "Starting device plugin registration server" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775559 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775572 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775679 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775766 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.775777 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.776402 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.776452 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.876831 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.879435 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.879466 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.879481 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.879514 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-252.ec2.internal" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.887696 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-252.ec2.internal" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.887717 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-252.ec2.internal\": node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.915454 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.919374 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.925069 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.925104 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.925124 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:26.925159 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 17:39:26.988462 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:26.928550 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.017644 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.025330 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal"] Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.025418 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.028057 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.028086 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.028099 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.030355 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.030492 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.030521 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031361 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031365 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031383 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031392 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031396 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.031407 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.033379 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.033403 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.036594 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.036617 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.036628 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.053900 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-252.ec2.internal\" not found" node="ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.065208 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-252.ec2.internal\" not found" node="ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.088146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.088175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.088256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.155963 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.118827 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188759 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188849 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbcfbc2fdebeb48346da1bb838f11040-config\") pod \"kube-apiserver-proxy-ip-10-0-135-252.ec2.internal\" (UID: \"bbcfbc2fdebeb48346da1bb838f11040\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188852 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.188882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb7529d0ca1f7fbba34204ef0f772b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal\" (UID: \"58eb7529d0ca1f7fbba34204ef0f772b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.220216 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.328893 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.322557 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.505616 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.356120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.505616 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.368350 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:27.505616 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.422977 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.680239 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.523315 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.680239 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.601390 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 17:39:27.680239 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.601553 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 17:39:27.680239 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.624100 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.857274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.704689 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:39:27.857274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.723649 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:34:26 +0000 UTC" deadline="2028-03-17 14:08:27.62219299 +0000 UTC" Jul 09 17:39:27.857274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:27.723675 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14804h28m59.898520436s" Jul 09 17:39:27.857274 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.724813 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:27.857274 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.825942 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:28.049282 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:27.926943 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:28.049282 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:28.027990 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:28.088190 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58eb7529d0ca1f7fbba34204ef0f772b.slice/crio-0828842cb3d8207cd135f61b6f55c82354392948751ae714b7ed48a104d244fe WatchSource:0}: Error finding container 0828842cb3d8207cd135f61b6f55c82354392948751ae714b7ed48a104d244fe: Status 404 returned error can't find the container with id 0828842cb3d8207cd135f61b6f55c82354392948751ae714b7ed48a104d244fe Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.094179 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:28.100488 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcfbc2fdebeb48346da1bb838f11040.slice/crio-5ab244f1781bcfa5ec017cc6f6c0772d8b6a4bc0ba09f667803300939481239d WatchSource:0}: Error finding container 5ab244f1781bcfa5ec017cc6f6c0772d8b6a4bc0ba09f667803300939481239d: Status 404 returned error can't find the container with id 5ab244f1781bcfa5ec017cc6f6c0772d8b6a4bc0ba09f667803300939481239d Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:28.130952 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-252.ec2.internal\" not found" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.169594 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.184235 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.185276 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.197034 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.198122 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" Jul 09 17:39:28.226955 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.211528 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 17:39:28.797062 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.797028 2557 apiserver.go:52] "Watching apiserver" Jul 09 17:39:28.797791 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.797118 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 17:39:28.817529 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.817483 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 17:39:28.818903 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.818871 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jphq7","kube-system/konnectivity-agent-5rvlp","kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx","openshift-dns/node-resolver-sbfkc","openshift-image-registry/node-ca-zf696","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal","openshift-network-diagnostics/network-check-target-bkf6h","openshift-cluster-node-tuning-operator/tuned-bdrnd","openshift-multus/multus-564cv","openshift-multus/multus-additional-cni-plugins-5vts7","openshift-multus/network-metrics-daemon-v4tlr","openshift-network-operator/iptables-alerter-7pljg","openshift-ovn-kubernetes/ovnkube-node-zpzmp"] Jul 09 17:39:28.821796 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.821714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-564cv" Jul 09 17:39:28.822800 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.822617 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 17:39:28.824586 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.824297 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:28.824944 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.824767 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.824944 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.824833 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nqnrf\"" Jul 09 17:39:28.825428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.825201 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.825533 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.825507 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 17:39:28.825890 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.825722 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 17:39:28.827583 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.826848 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.829010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.828425 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.829010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.828684 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.829010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.828797 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 17:39:28.829010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.828913 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tgcnp\"" Jul 09 17:39:28.829786 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.829395 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.831153 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.831130 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 17:39:28.831518 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.831488 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4w56t\"" Jul 09 17:39:28.831616 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.831480 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.833794 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.833773 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:28.835371 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.835198 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 17:39:28.835543 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.835219 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 17:39:28.835852 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.835835 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 17:39:28.835932 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.835915 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zmhvw\"" Jul 09 17:39:28.836050 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.836034 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.836173 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.836156 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.838939 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.838114 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 17:39:28.838939 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.838160 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r2bwc\"" Jul 09 17:39:28.838939 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.838463 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.838939 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.838696 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.839180 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.839002 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:28.840762 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.840744 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.843292 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.843237 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.846274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.846254 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-72sld" Jul 09 17:39:28.846794 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.846480 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.847801 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.846636 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.848484 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.846675 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 17:39:28.848484 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.846727 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rbh52\"" Jul 09 17:39:28.848484 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.847610 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:28.848484 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:28.848368 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:28.849301 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.848999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pgblv\"" Jul 09 17:39:28.849301 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.849222 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 17:39:28.849844 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.849513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 17:39:28.850945 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.850925 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:28.853811 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.853790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 17:39:28.854142 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.854110 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nbg5l\"" Jul 09 17:39:28.854431 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.854387 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 17:39:28.854599 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.854584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:28.854684 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:28.854661 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:28.858145 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.857526 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.860151 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.860046 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:28.860151 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:28.860116 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:28.860798 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.860778 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-72sld" Jul 09 17:39:28.861495 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.861182 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 17:39:28.861495 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.861305 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 17:39:28.861495 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.861458 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cfhd6\"" Jul 09 17:39:28.886433 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.886411 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897649 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-bin\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897687 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-run\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897717 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-cni-binary-copy\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-netns\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-multus\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-hostroot\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-multus-daemon-config\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897860 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-socket-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-sys-fs\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.897975 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68f3754d-1785-4f1f-80a1-7a1413c91e48-agent-certs\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68f3754d-1785-4f1f-80a1-7a1413c91e48-konnectivity-ca\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:28.898474 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-lib-modules\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-host\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-kubelet\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-conf-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-multus-certs\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr44h\" (UniqueName: \"kubernetes.io/projected/6bb48da8-8dcd-4caa-8f0b-766ea9639952-kube-api-access-fr44h\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-device-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898275 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c638e-f844-41c7-9591-bf021acc560c-host\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-config\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-os-release\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca39a8-3520-421b-b6d6-6baa0d462e68-hosts-file\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c638e-f844-41c7-9591-bf021acc560c-serviceca\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:28.899246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-systemd-units\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-netns\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-kubelet\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-node-log\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898657 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-script-lib\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwk4r\" (UniqueName: \"kubernetes.io/projected/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-kube-api-access-nwk4r\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-kubernetes\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dbz8\" (UniqueName: \"kubernetes.io/projected/b01c638e-f844-41c7-9591-bf021acc560c-kube-api-access-8dbz8\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-ovn\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-netd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-conf\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.899934 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-sys\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-modprobe-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca39a8-3520-421b-b6d6-6baa0d462e68-tmp-dir\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wkrv\" (UniqueName: \"kubernetes.io/projected/26ca39a8-3520-421b-b6d6-6baa0d462e68-kube-api-access-5wkrv\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898950 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898975 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-var-lib-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.898994 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-cnibin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-bin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fc7z\" (UniqueName: \"kubernetes.io/projected/40859ee7-b179-4bc9-ae44-022721d3be04-kube-api-access-6fc7z\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-tmp\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-etc-kubernetes\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-etc-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.900650 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysconfig\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-system-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bb48da8-8dcd-4caa-8f0b-766ea9639952-iptables-alerter-script\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899275 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899311 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bb48da8-8dcd-4caa-8f0b-766ea9639952-host-slash\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899350 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-log-socket\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899412 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdb58\" (UniqueName: \"kubernetes.io/projected/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-kube-api-access-sdb58\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjbcr\" (UniqueName: \"kubernetes.io/projected/b7d10a68-ae3e-422d-8497-ce589275a277-kube-api-access-cjbcr\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899473 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-registration-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rmsq\" (UniqueName: \"kubernetes.io/projected/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kube-api-access-5rmsq\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-system-cni-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-slash\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.901311 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-env-overrides\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-etc-tuned\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-os-release\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-systemd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-systemd\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6g5\" (UniqueName: \"kubernetes.io/projected/9a433e11-e016-445d-8ea1-080510088ece-kube-api-access-df6g5\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-kubelet-config\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899908 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-socket-dir-parent\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.899973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-cnibin\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.900014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-var-lib-kubelet\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:28.901989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.900042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-dbus\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:28.902671 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.900075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-k8s-cni-cncf-io\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:28.934350 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.934209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" event={"ID":"bbcfbc2fdebeb48346da1bb838f11040","Type":"ContainerStarted","Data":"5ab244f1781bcfa5ec017cc6f6c0772d8b6a4bc0ba09f667803300939481239d"} Jul 09 17:39:28.936252 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:28.936209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerStarted","Data":"0828842cb3d8207cd135f61b6f55c82354392948751ae714b7ed48a104d244fe"} Jul 09 17:39:29.000525 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-etc-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysconfig\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-system-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bb48da8-8dcd-4caa-8f0b-766ea9639952-iptables-alerter-script\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bb48da8-8dcd-4caa-8f0b-766ea9639952-host-slash\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-log-socket\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.000715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000729 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdb58\" (UniqueName: \"kubernetes.io/projected/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-kube-api-access-sdb58\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjbcr\" (UniqueName: \"kubernetes.io/projected/b7d10a68-ae3e-422d-8497-ce589275a277-kube-api-access-cjbcr\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-registration-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rmsq\" (UniqueName: \"kubernetes.io/projected/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kube-api-access-5rmsq\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-system-cni-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-slash\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-env-overrides\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000972 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-etc-tuned\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.000997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-os-release\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.001044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001023 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001051 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-systemd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-systemd\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001103 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6g5\" (UniqueName: \"kubernetes.io/projected/9a433e11-e016-445d-8ea1-080510088ece-kube-api-access-df6g5\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-kubelet-config\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-socket-dir-parent\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-cnibin\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-var-lib-kubelet\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-dbus\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-k8s-cni-cncf-io\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-bin\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-run\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-cni-binary-copy\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001430 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-netns\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.001620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-multus\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-hostroot\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-multus-daemon-config\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-socket-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-sys-fs\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001618 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68f3754d-1785-4f1f-80a1-7a1413c91e48-agent-certs\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68f3754d-1785-4f1f-80a1-7a1413c91e48-konnectivity-ca\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001718 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-lib-modules\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-host\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-kubelet\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-conf-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-multus-certs\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.002310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001840 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 17:39:29.002997 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.002348 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:29.002997 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.002427 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:29.502401419 +0000 UTC m=+3.248390346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:29.002997 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.002702 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-etc-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.002997 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.002784 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysconfig\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.002997 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.002838 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-system-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.003281 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003071 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-os-release\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003441 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bb48da8-8dcd-4caa-8f0b-766ea9639952-iptables-alerter-script\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003585 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003621 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003632 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-log-socket\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003644 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bb48da8-8dcd-4caa-8f0b-766ea9639952-host-slash\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003648 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-registration-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003675 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-systemd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003705 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-system-cni-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-hostroot\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-multus\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-slash\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003790 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-k8s-cni-cncf-io\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003795 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-var-lib-kubelet\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003846 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-bin\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003875 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-netns\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.001869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr44h\" (UniqueName: \"kubernetes.io/projected/6bb48da8-8dcd-4caa-8f0b-766ea9639952-kube-api-access-fr44h\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-device-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003967 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c638e-f844-41c7-9591-bf021acc560c-host\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.003995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-config\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004068 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-os-release\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca39a8-3520-421b-b6d6-6baa0d462e68-hosts-file\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c638e-f844-41c7-9591-bf021acc560c-serviceca\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004210 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-systemd-units\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-netns\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004258 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-env-overrides\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004277 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-kubelet\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.006887 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004342 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-multus-daemon-config\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-node-log\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004401 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-systemd\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004399 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7d10a68-ae3e-422d-8497-ce589275a277-cni-binary-copy\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-script-lib\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004470 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68f3754d-1785-4f1f-80a1-7a1413c91e48-konnectivity-ca\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwk4r\" (UniqueName: \"kubernetes.io/projected/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-kube-api-access-nwk4r\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004513 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-lib-modules\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-kubernetes\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004561 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004568 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-run-multus-certs\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004563 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-conf-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dbz8\" (UniqueName: \"kubernetes.io/projected/b01c638e-f844-41c7-9591-bf021acc560c-kube-api-access-8dbz8\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004623 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c638e-f844-41c7-9591-bf021acc560c-host\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.007651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004630 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-ovn\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004667 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-socket-dir-parent\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-netd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.004719 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-kubelet\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-conf\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.004774 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:29.504755584 +0000 UTC m=+3.250744499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-device-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004886 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-run\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004902 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-conf\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-dbus\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-sys\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-modprobe-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.008439 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005008 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-cnibin\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-sysctl-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005028 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-socket-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004974 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-sys-fs\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005056 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10ab9a00-7c69-4d92-a688-968b3ad604e7-kubelet-config\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca39a8-3520-421b-b6d6-6baa0d462e68-tmp-dir\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005109 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-netns\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.004660 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wkrv\" (UniqueName: \"kubernetes.io/projected/26ca39a8-3520-421b-b6d6-6baa0d462e68-kube-api-access-5wkrv\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005109 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-multus-cni-dir\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005155 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-ovn\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-var-lib-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005168 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-kubelet\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005203 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-run-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005230 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-cnibin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005246 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-var-lib-openvswitch\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005216 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-bin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005279 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-sys\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005301 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005313 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca39a8-3520-421b-b6d6-6baa0d462e68-hosts-file\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fc7z\" (UniqueName: \"kubernetes.io/projected/40859ee7-b179-4bc9-ae44-022721d3be04-kube-api-access-6fc7z\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005358 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-tmp\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005364 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-kubernetes\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-etc-kubernetes\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005450 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-etc-modprobe-d\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005505 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-host-cni-netd\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-script-lib\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.009976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005778 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca39a8-3520-421b-b6d6-6baa0d462e68-tmp-dir\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c638e-f844-41c7-9591-bf021acc560c-serviceca\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005824 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovnkube-config\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005860 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-etc-kubernetes\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005876 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-systemd-units\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005909 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a433e11-e016-445d-8ea1-080510088ece-host\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005934 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-cnibin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005950 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-host-var-lib-cni-bin\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005973 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.005989 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7d10a68-ae3e-422d-8497-ce589275a277-os-release\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.006022 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-node-log\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.006024 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40859ee7-b179-4bc9-ae44-022721d3be04-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.006561 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40859ee7-b179-4bc9-ae44-022721d3be04-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.007117 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-etc-tuned\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.010737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.007968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.011438 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.010933 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68f3754d-1785-4f1f-80a1-7a1413c91e48-agent-certs\") pod \"konnectivity-agent-5rvlp\" (UID: \"68f3754d-1785-4f1f-80a1-7a1413c91e48\") " pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:29.012383 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.012358 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a433e11-e016-445d-8ea1-080510088ece-tmp\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.015333 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.014979 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr44h\" (UniqueName: \"kubernetes.io/projected/6bb48da8-8dcd-4caa-8f0b-766ea9639952-kube-api-access-fr44h\") pod \"iptables-alerter-7pljg\" (UID: \"6bb48da8-8dcd-4caa-8f0b-766ea9639952\") " pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.015956 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.015825 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:29.015956 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.015854 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:29.015956 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.015868 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:29.015956 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.015933 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:29.515913976 +0000 UTC m=+3.261902896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:29.017860 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.017831 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wkrv\" (UniqueName: \"kubernetes.io/projected/26ca39a8-3520-421b-b6d6-6baa0d462e68-kube-api-access-5wkrv\") pod \"node-resolver-sbfkc\" (UID: \"26ca39a8-3520-421b-b6d6-6baa0d462e68\") " pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.021339 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.021172 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fc7z\" (UniqueName: \"kubernetes.io/projected/40859ee7-b179-4bc9-ae44-022721d3be04-kube-api-access-6fc7z\") pod \"multus-additional-cni-plugins-5vts7\" (UID: \"40859ee7-b179-4bc9-ae44-022721d3be04\") " pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.022253 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.022186 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6g5\" (UniqueName: \"kubernetes.io/projected/9a433e11-e016-445d-8ea1-080510088ece-kube-api-access-df6g5\") pod \"tuned-bdrnd\" (UID: \"9a433e11-e016-445d-8ea1-080510088ece\") " pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.022673 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.022629 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjbcr\" (UniqueName: \"kubernetes.io/projected/b7d10a68-ae3e-422d-8497-ce589275a277-kube-api-access-cjbcr\") pod \"multus-564cv\" (UID: \"b7d10a68-ae3e-422d-8497-ce589275a277\") " pod="openshift-multus/multus-564cv" Jul 09 17:39:29.022673 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.022666 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dbz8\" (UniqueName: \"kubernetes.io/projected/b01c638e-f844-41c7-9591-bf021acc560c-kube-api-access-8dbz8\") pod \"node-ca-zf696\" (UID: \"b01c638e-f844-41c7-9591-bf021acc560c\") " pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.023408 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.023364 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwk4r\" (UniqueName: \"kubernetes.io/projected/e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a-kube-api-access-nwk4r\") pod \"ovnkube-node-zpzmp\" (UID: \"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.023964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.023885 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rmsq\" (UniqueName: \"kubernetes.io/projected/05f9a6ea-e8a0-41a2-a991-db75f04e0483-kube-api-access-5rmsq\") pod \"aws-ebs-csi-driver-node-sgprx\" (UID: \"05f9a6ea-e8a0-41a2-a991-db75f04e0483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.025154 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.025134 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdb58\" (UniqueName: \"kubernetes.io/projected/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-kube-api-access-sdb58\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:29.140244 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.140202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-564cv" Jul 09 17:39:29.149312 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.149247 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pljg" Jul 09 17:39:29.159374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.159342 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:39:29.163548 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.163497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:29.176994 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.176955 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" Jul 09 17:39:29.185193 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.185160 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sbfkc" Jul 09 17:39:29.193141 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.193114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf696" Jul 09 17:39:29.203257 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.203232 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" Jul 09 17:39:29.210155 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.210130 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:29.219915 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.219888 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5vts7" Jul 09 17:39:29.508569 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.508479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:29.508731 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.508634 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:29.508731 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.508710 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:30.508691195 +0000 UTC m=+4.254680118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:29.508731 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.508703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:29.508875 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.508808 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:29.508918 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.508875 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:30.508857717 +0000 UTC m=+4.254846630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:29.609734 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.609698 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:29.609924 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.609888 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:29.609924 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.609916 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:29.609924 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.609926 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:29.610051 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:29.609981 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:30.609966525 +0000 UTC m=+4.355955435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:29.865380 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.865302 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:34:28 +0000 UTC" deadline="2028-03-03 01:35:15.687436749 +0000 UTC" Jul 09 17:39:29.865380 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:29.865369 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14455h55m45.82207132s" Jul 09 17:39:30.123265 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.123235 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17f935c_cd79_4f5b_ba84_e5a0ff1c2d1a.slice/crio-e306ebb6ad4ec2abcf71e07b59592a171a029682faa01ba765e83259dd9cd0ab WatchSource:0}: Error finding container e306ebb6ad4ec2abcf71e07b59592a171a029682faa01ba765e83259dd9cd0ab: Status 404 returned error can't find the container with id e306ebb6ad4ec2abcf71e07b59592a171a029682faa01ba765e83259dd9cd0ab Jul 09 17:39:30.126086 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.126052 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb48da8_8dcd_4caa_8f0b_766ea9639952.slice/crio-472e9b90d3a792a2373fe50f9d0f693cf166486952ade6c0c149a3f3aba7c4e7 WatchSource:0}: Error finding container 472e9b90d3a792a2373fe50f9d0f693cf166486952ade6c0c149a3f3aba7c4e7: Status 404 returned error can't find the container with id 472e9b90d3a792a2373fe50f9d0f693cf166486952ade6c0c149a3f3aba7c4e7 Jul 09 17:39:30.126429 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.126409 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a433e11_e016_445d_8ea1_080510088ece.slice/crio-8f8ee0cdafe6ddc687c7c690e47ea45885242d65c0ad1d3ced1e7bb6a12e96c5 WatchSource:0}: Error finding container 8f8ee0cdafe6ddc687c7c690e47ea45885242d65c0ad1d3ced1e7bb6a12e96c5: Status 404 returned error can't find the container with id 8f8ee0cdafe6ddc687c7c690e47ea45885242d65c0ad1d3ced1e7bb6a12e96c5 Jul 09 17:39:30.127420 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.127405 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ca39a8_3520_421b_b6d6_6baa0d462e68.slice/crio-1a74112845b91370ee7ab4f541804ffb1d0ce9af7dcd77827105b09d13390437 WatchSource:0}: Error finding container 1a74112845b91370ee7ab4f541804ffb1d0ce9af7dcd77827105b09d13390437: Status 404 returned error can't find the container with id 1a74112845b91370ee7ab4f541804ffb1d0ce9af7dcd77827105b09d13390437 Jul 09 17:39:30.128392 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.128284 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d10a68_ae3e_422d_8497_ce589275a277.slice/crio-f224c9b624cd0077dad46c8dda48ce13d86f6090acd5390a5787569b3be2f731 WatchSource:0}: Error finding container f224c9b624cd0077dad46c8dda48ce13d86f6090acd5390a5787569b3be2f731: Status 404 returned error can't find the container with id f224c9b624cd0077dad46c8dda48ce13d86f6090acd5390a5787569b3be2f731 Jul 09 17:39:30.149544 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.149521 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f3754d_1785_4f1f_80a1_7a1413c91e48.slice/crio-d0578ba92939f52932ef4a47b6e3dd3ed0f1ac137aa1c6e519220af1859c775e WatchSource:0}: Error finding container d0578ba92939f52932ef4a47b6e3dd3ed0f1ac137aa1c6e519220af1859c775e: Status 404 returned error can't find the container with id d0578ba92939f52932ef4a47b6e3dd3ed0f1ac137aa1c6e519220af1859c775e Jul 09 17:39:30.150747 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.150716 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40859ee7_b179_4bc9_ae44_022721d3be04.slice/crio-e87987dc2e20b095aeaa9bf75f61cd9a13701786e84bf527793e2606287208dd WatchSource:0}: Error finding container e87987dc2e20b095aeaa9bf75f61cd9a13701786e84bf527793e2606287208dd: Status 404 returned error can't find the container with id e87987dc2e20b095aeaa9bf75f61cd9a13701786e84bf527793e2606287208dd Jul 09 17:39:30.152324 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.152288 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01c638e_f844_41c7_9591_bf021acc560c.slice/crio-5a586216eb0b37dea73468076006786498734068156b3702014371bf3320fc03 WatchSource:0}: Error finding container 5a586216eb0b37dea73468076006786498734068156b3702014371bf3320fc03: Status 404 returned error can't find the container with id 5a586216eb0b37dea73468076006786498734068156b3702014371bf3320fc03 Jul 09 17:39:30.153557 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:39:30.153518 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f9a6ea_e8a0_41a2_a991_db75f04e0483.slice/crio-e6098c17e7bda450deef518fce222918226e498344352d646c7ef112dc9f23bc WatchSource:0}: Error finding container e6098c17e7bda450deef518fce222918226e498344352d646c7ef112dc9f23bc: Status 404 returned error can't find the container with id e6098c17e7bda450deef518fce222918226e498344352d646c7ef112dc9f23bc Jul 09 17:39:30.516277 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.516063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:30.516452 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.516293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:30.516452 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.516195 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:30.516452 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.516393 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:30.516452 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.516419 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:32.516398371 +0000 UTC m=+6.262387294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:30.516452 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.516441 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:32.516430264 +0000 UTC m=+6.262419174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:30.618263 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.617606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:30.618263 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.617788 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:30.618263 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.617807 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:30.618263 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.617820 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:30.618263 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.617877 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:32.617859137 +0000 UTC m=+6.363848048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:30.865550 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.865508 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:34:28 +0000 UTC" deadline="2028-01-16 08:40:01.354891024 +0000 UTC" Jul 09 17:39:30.866002 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.865548 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13335h0m30.489347299s" Jul 09 17:39:30.928017 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.927984 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:30.928223 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.928113 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:30.928534 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.928516 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:30.928634 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.928617 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:30.928698 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.928678 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:30.928796 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:30.928759 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:30.950573 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.950543 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rvlp" event={"ID":"68f3754d-1785-4f1f-80a1-7a1413c91e48","Type":"ContainerStarted","Data":"d0578ba92939f52932ef4a47b6e3dd3ed0f1ac137aa1c6e519220af1859c775e"} Jul 09 17:39:30.955407 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.955375 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-564cv" event={"ID":"b7d10a68-ae3e-422d-8497-ce589275a277","Type":"ContainerStarted","Data":"f224c9b624cd0077dad46c8dda48ce13d86f6090acd5390a5787569b3be2f731"} Jul 09 17:39:30.961724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.961692 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"e306ebb6ad4ec2abcf71e07b59592a171a029682faa01ba765e83259dd9cd0ab"} Jul 09 17:39:30.968127 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.968097 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" event={"ID":"9a433e11-e016-445d-8ea1-080510088ece","Type":"ContainerStarted","Data":"8f8ee0cdafe6ddc687c7c690e47ea45885242d65c0ad1d3ced1e7bb6a12e96c5"} Jul 09 17:39:30.970975 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.970943 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sbfkc" event={"ID":"26ca39a8-3520-421b-b6d6-6baa0d462e68","Type":"ContainerStarted","Data":"1a74112845b91370ee7ab4f541804ffb1d0ce9af7dcd77827105b09d13390437"} Jul 09 17:39:30.973319 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.973294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pljg" event={"ID":"6bb48da8-8dcd-4caa-8f0b-766ea9639952","Type":"ContainerStarted","Data":"472e9b90d3a792a2373fe50f9d0f693cf166486952ade6c0c149a3f3aba7c4e7"} Jul 09 17:39:30.977005 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.976978 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" event={"ID":"bbcfbc2fdebeb48346da1bb838f11040","Type":"ContainerStarted","Data":"f57c84f1618c64464af70218000b5be11f120295c42ea8826c18456d69136d24"} Jul 09 17:39:30.985431 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.985403 2557 generic.go:356] "Generic (PLEG): container finished" podID="58eb7529d0ca1f7fbba34204ef0f772b" containerID="5d74327b05526d244873eec8a3878f93670b62686a6e78af41db4e82f96b03b2" exitCode=0 Jul 09 17:39:30.985534 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:30.985484 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerDied","Data":"5d74327b05526d244873eec8a3878f93670b62686a6e78af41db4e82f96b03b2"} Jul 09 17:39:31.015592 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:31.015553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" event={"ID":"05f9a6ea-e8a0-41a2-a991-db75f04e0483","Type":"ContainerStarted","Data":"e6098c17e7bda450deef518fce222918226e498344352d646c7ef112dc9f23bc"} Jul 09 17:39:31.018813 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:31.018780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf696" event={"ID":"b01c638e-f844-41c7-9591-bf021acc560c","Type":"ContainerStarted","Data":"5a586216eb0b37dea73468076006786498734068156b3702014371bf3320fc03"} Jul 09 17:39:31.024520 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:31.024486 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerStarted","Data":"e87987dc2e20b095aeaa9bf75f61cd9a13701786e84bf527793e2606287208dd"} Jul 09 17:39:31.029634 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:31.029578 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-252.ec2.internal" podStartSLOduration=3.029556762 podStartE2EDuration="3.029556762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.010378499 +0000 UTC m=+4.756367430" watchObservedRunningTime="2026-07-09 17:39:31.029556762 +0000 UTC m=+4.775545693" Jul 09 17:39:32.053263 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.053229 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" event={"ID":"58eb7529d0ca1f7fbba34204ef0f772b","Type":"ContainerStarted","Data":"540adae933aae27c61f42951e98291fd29708149fc1570b0229f531f6b4e5fea"} Jul 09 17:39:32.072135 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.072076 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-252.ec2.internal" podStartSLOduration=4.072053527 podStartE2EDuration="4.072053527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:32.071679927 +0000 UTC m=+5.817668859" watchObservedRunningTime="2026-07-09 17:39:32.072053527 +0000 UTC m=+5.818042458" Jul 09 17:39:32.532042 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.532006 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:32.532294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.532061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:32.532294 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.532204 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:32.532294 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.532265 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:36.532246692 +0000 UTC m=+10.278235603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:32.532691 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.532671 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:32.532763 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.532728 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:36.532712807 +0000 UTC m=+10.278701717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:32.633338 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.633298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:32.633583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.633517 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:32.633583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.633535 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:32.633583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.633548 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:32.633762 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.633609 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:36.63358975 +0000 UTC m=+10.379578662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.927832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.928348 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.928443 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:32.928508 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.928587 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:32.929286 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:32.927965 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:34.925928 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:34.925892 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:34.926425 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:34.926089 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:34.926544 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:34.926526 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:34.926649 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:34.926629 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:34.926775 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:34.926761 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:34.926881 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:34.926858 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:36.569360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.569309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:36.569813 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.569373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:36.569813 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.569507 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:36.569813 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.569568 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:44.569550282 +0000 UTC m=+18.315539205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:36.569813 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.569627 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:36.569813 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.569672 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:44.569658523 +0000 UTC m=+18.315647443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:36.669772 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.669735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:36.670009 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.669954 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:36.670009 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.669991 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:36.670125 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.670027 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:36.670125 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.670098 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:44.670077482 +0000 UTC m=+18.416066412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:36.926190 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.926053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:36.926364 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.926222 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:36.926364 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.926259 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:36.927373 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.927305 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:36.927373 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:36.927359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:36.927532 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:36.927442 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:38.930163 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:38.930074 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:38.930627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:38.930242 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:38.930627 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:38.930354 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:38.930627 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:38.930386 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:38.930627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:38.930482 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:38.930627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:38.930540 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:40.926153 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:40.926068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:40.926583 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:40.926068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:40.926583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:40.926204 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:40.926583 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:40.926068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:40.926583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:40.926278 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:40.926583 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:40.926393 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:42.925870 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:42.925838 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:42.926362 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:42.925834 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:42.926362 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:42.925977 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:42.926362 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:42.925995 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:42.926362 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:42.926061 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:42.926362 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:42.926106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:44.630479 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.630444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:44.630918 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.630497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:44.630918 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.630610 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:44.630918 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.630616 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:44.630918 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.630668 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.630653997 +0000 UTC m=+34.376642905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:39:44.630918 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.630682 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.630675538 +0000 UTC m=+34.376664446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:39:44.731230 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.731192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:44.731419 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.731345 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:39:44.731419 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.731365 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:39:44.731419 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.731378 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:44.731571 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.731445 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.731425905 +0000 UTC m=+34.477414820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:39:44.925562 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.925474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:44.925723 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.925474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:44.925723 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.925614 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:44.925723 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:44.925494 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:44.925723 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.925690 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:44.925929 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:44.925787 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:46.927089 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:46.927040 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:46.927539 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:46.927159 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:46.927539 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:46.927164 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:46.927539 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:46.927205 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:46.927539 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:46.927248 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:46.927539 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:46.927328 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:48.926080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:48.925870 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:48.926719 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:48.926180 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:48.926719 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:48.925912 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:48.926719 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:48.926286 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:48.926719 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:48.925871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:48.926719 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:48.926363 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:49.093624 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.093588 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" event={"ID":"05f9a6ea-e8a0-41a2-a991-db75f04e0483","Type":"ContainerStarted","Data":"c6c91120a2680a79b3b3e37d222e1f7511446522fcd63e360759ad5ea14c551f"} Jul 09 17:39:49.095843 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.095483 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf696" event={"ID":"b01c638e-f844-41c7-9591-bf021acc560c","Type":"ContainerStarted","Data":"6218aed4a40bf520fa622e7e103133b3b083602c4a5f593625b2529f75c9fbe6"} Jul 09 17:39:49.098106 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.098078 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="e06649f3b10f259dc5ed8f498c332d63c4a51513e35920ebca62296348ab1825" exitCode=0 Jul 09 17:39:49.098220 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.098156 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"e06649f3b10f259dc5ed8f498c332d63c4a51513e35920ebca62296348ab1825"} Jul 09 17:39:49.100046 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.099946 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rvlp" event={"ID":"68f3754d-1785-4f1f-80a1-7a1413c91e48","Type":"ContainerStarted","Data":"7c3c75de53229135cccb220e2ae81c0bfa989f048f02aec9ccad888cf8b668ac"} Jul 09 17:39:49.101686 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.101663 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-564cv" event={"ID":"b7d10a68-ae3e-422d-8497-ce589275a277","Type":"ContainerStarted","Data":"8b56bc093b89f0d7365feb9860b3058a8ad42999ed98760b32f556e855cef793"} Jul 09 17:39:49.103828 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.103697 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:39:49.104221 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.104200 2557 generic.go:356] "Generic (PLEG): container finished" podID="e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a" containerID="fc61794de701e15e1cb53048ecd1616af3f6e5a8ebf73ee9367aa86b4aca8d5a" exitCode=1 Jul 09 17:39:49.104221 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.104211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"7d19e3911ec16f6ab97537f524b8869229f792e14bc99db5964d40b737453722"} Jul 09 17:39:49.104360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.104268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerDied","Data":"fc61794de701e15e1cb53048ecd1616af3f6e5a8ebf73ee9367aa86b4aca8d5a"} Jul 09 17:39:49.104360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.104299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"5080e1dcdd3861739f7ad53dce9b06b4c13e06f2c9735534d4b403bcd4ecce55"} Jul 09 17:39:49.105672 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.105650 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" event={"ID":"9a433e11-e016-445d-8ea1-080510088ece","Type":"ContainerStarted","Data":"e2736d6eb84f97067ee21966ce45368c4c7a603b1afcb69bdcdc6f5c4b6571cf"} Jul 09 17:39:49.106940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.106923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sbfkc" event={"ID":"26ca39a8-3520-421b-b6d6-6baa0d462e68","Type":"ContainerStarted","Data":"c7fa8cda46c06d4eb456e7573165cf9010c754cb005e7da7699fc1766ae45f9a"} Jul 09 17:39:49.113356 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.113300 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zf696" podStartSLOduration=7.929889814 podStartE2EDuration="22.113280994s" totalImagesPullingTime="14.18339118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:49.112454857 +0000 UTC m=+22.858443794" watchObservedRunningTime="2026-07-09 17:39:49.113280994 +0000 UTC m=+22.859269924" Jul 09 17:39:49.134013 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.133967 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-564cv" podStartSLOduration=3.5314919849999997 podStartE2EDuration="22.133944348s" totalImagesPullingTime="18.602452363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:49.133865613 +0000 UTC m=+22.879854543" watchObservedRunningTime="2026-07-09 17:39:49.133944348 +0000 UTC m=+22.879933277" Jul 09 17:39:49.153238 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.153082 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5rvlp" podStartSLOduration=7.967548487 podStartE2EDuration="22.153060652s" totalImagesPullingTime="14.185512165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:49.153044081 +0000 UTC m=+22.899033012" watchObservedRunningTime="2026-07-09 17:39:49.153060652 +0000 UTC m=+22.899049590" Jul 09 17:39:49.213368 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.213277 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sbfkc" podStartSLOduration=3.667542883 podStartE2EDuration="22.213259222s" totalImagesPullingTime="18.545716339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:49.213246389 +0000 UTC m=+22.959235320" watchObservedRunningTime="2026-07-09 17:39:49.213259222 +0000 UTC m=+22.959248154" Jul 09 17:39:49.248062 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.248018 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bdrnd" podStartSLOduration=3.687931846 podStartE2EDuration="22.248001463s" totalImagesPullingTime="18.560069617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:49.247518595 +0000 UTC m=+22.993507525" watchObservedRunningTime="2026-07-09 17:39:49.248001463 +0000 UTC m=+22.993990393" Jul 09 17:39:49.367065 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.367025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:49.517696 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.517609 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:49.620038 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.619990 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:49.764615 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.764556 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:49.765223 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:49.765205 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:50.113346 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.113324 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:39:50.113927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.113721 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"cc56c9915fef5160c17e14894af72831c9a6778e8d6975173e2a5bfa4dab31f6"} Jul 09 17:39:50.113927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.113808 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"4f11090841b6032b9fc319c4e93f4bc0d8c1ce53d51cd9bc41056037afea63d1"} Jul 09 17:39:50.113927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.113859 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"6c42fbbb4a0f1854a1b0c91495ec4657510c1a29216361375577f296b41e028f"} Jul 09 17:39:50.174537 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.174503 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 17:39:50.410130 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.410089 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:50.511990 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.511959 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:50.631469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.631434 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:50.731944 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.731849 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:50.809279 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.809134 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T17:39:50.174521835Z","UUID":"0e850185-e690-4009-9b2d-ea2cb3400823","Handler":null,"Name":"","Endpoint":""} Jul 09 17:39:50.810849 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.810820 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 17:39:50.810976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.810868 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 17:39:50.926234 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.926202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:50.926496 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.926202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:50.926496 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:50.926335 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:50.926496 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:50.926344 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:50.926496 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:50.926439 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:50.926750 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:50.926530 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:51.118785 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.118472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pljg" event={"ID":"6bb48da8-8dcd-4caa-8f0b-766ea9639952","Type":"ContainerStarted","Data":"08bb78c18ede1773ada0365564537011dd40bef55070b0b00c9eb4c01a8807c6"} Jul 09 17:39:51.121147 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.121126 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 17:39:51.121147 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.121131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" event={"ID":"05f9a6ea-e8a0-41a2-a991-db75f04e0483","Type":"ContainerStarted","Data":"ca70e7a7da2086046431e25a333ecddc84718142251932e907e12da5992c8ed2"} Jul 09 17:39:51.409958 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.409906 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:51.509704 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.509678 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:51.807465 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.807183 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:51.907228 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:51.907190 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:52.126008 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.125971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" event={"ID":"05f9a6ea-e8a0-41a2-a991-db75f04e0483","Type":"ContainerStarted","Data":"54a9a0c1b9f775bc2e35e113b0b43dafd3aa3f1fefeafb0357c29fa86c8a68c0"} Jul 09 17:39:52.129414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.129389 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:39:52.129807 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.129786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"a0b5b500d5bdf06bcce9428ade5a3dc6303240f0de66a32cdd3c8c064379c9f7"} Jul 09 17:39:52.148345 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.148279 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7pljg" podStartSLOduration=6.600365902 podStartE2EDuration="25.148254297s" totalImagesPullingTime="18.547888395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:51.145087375 +0000 UTC m=+24.891076310" watchObservedRunningTime="2026-07-09 17:39:52.148254297 +0000 UTC m=+25.894243228" Jul 09 17:39:52.162428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.162378 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:52.230207 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.230147 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:52.307048 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.307003 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:52.926125 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.926093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:52.926125 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.926110 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:52.926423 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:52.926102 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:52.926423 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:52.926219 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:52.926423 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:52.926301 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:52.926574 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:52.926417 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:53.986496 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:53.986315 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:54.053035 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.052998 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:54.134909 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.134875 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="e211c39c58a6994e9d410bf61782fc0edf0c104c1ca7e485c7de33f8d6430a3d" exitCode=0 Jul 09 17:39:54.135092 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.134969 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"e211c39c58a6994e9d410bf61782fc0edf0c104c1ca7e485c7de33f8d6430a3d"} Jul 09 17:39:54.138572 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.138554 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:39:54.138872 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.138852 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"9bc3f58e02d0064a791d998a21446000f19b85ec63b8d77c291600aee390063e"} Jul 09 17:39:54.139107 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.139085 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:54.139233 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.139219 2557 scope.go:117] "RemoveContainer" containerID="fc61794de701e15e1cb53048ecd1616af3f6e5a8ebf73ee9367aa86b4aca8d5a" Jul 09 17:39:54.155420 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.155400 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:54.159698 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.159661 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgprx" podStartSLOduration=6.331035187 podStartE2EDuration="27.159647943s" totalImagesPullingTime="20.828612756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:52.149016891 +0000 UTC m=+25.895005821" watchObservedRunningTime="2026-07-09 17:39:54.159647943 +0000 UTC m=+27.905636872" Jul 09 17:39:54.925878 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.925840 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:54.926129 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:54.925983 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:54.926129 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.925846 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:54.926283 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:54.926142 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:54.926283 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:54.926193 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:54.926283 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:54.926261 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:55.145446 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.145423 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:39:55.145862 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.145837 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" event={"ID":"e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a","Type":"ContainerStarted","Data":"a65e71033c6ed1b21df2cfc2be3d8be67ed729f83434fcce66a89b360bc4121d"} Jul 09 17:39:55.146090 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.146065 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:55.146211 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.146145 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:55.165479 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.165425 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:39:55.180138 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.180049 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" podStartSLOduration=9.540313534 podStartE2EDuration="28.180027531s" totalImagesPullingTime="18.639713997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:55.177510201 +0000 UTC m=+28.923499131" watchObservedRunningTime="2026-07-09 17:39:55.180027531 +0000 UTC m=+28.926016462" Jul 09 17:39:55.885545 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.885351 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4tlr"] Jul 09 17:39:55.885719 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.885661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:55.885770 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:55.885747 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:55.888884 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.888849 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkf6h"] Jul 09 17:39:55.889031 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.888975 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:55.889097 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:55.889062 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:55.889561 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.889541 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jphq7"] Jul 09 17:39:55.889654 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:55.889626 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:55.889723 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:55.889699 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:56.149868 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.149834 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="19a06b8b73fbf4056910ca9466caa43f2705beebd38d1e3f49c35e8f673d043f" exitCode=0 Jul 09 17:39:56.150289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.149915 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"19a06b8b73fbf4056910ca9466caa43f2705beebd38d1e3f49c35e8f673d043f"} Jul 09 17:39:56.783728 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.783696 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:56.783908 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.783837 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 17:39:56.784589 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.784565 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5rvlp" Jul 09 17:39:56.854250 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.854218 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:39:56.926156 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:56.926125 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:56.926327 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:56.926226 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:57.925550 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:57.925458 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:57.926310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:57.925458 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:57.926310 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:57.925598 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:39:57.926310 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:57.925635 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:58.157546 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:58.157515 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="86fb3c3db3ce3d545a1cd6f774db5507edbb939068fa75eca5bf51c29146dbe6" exitCode=0 Jul 09 17:39:58.157727 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:58.157552 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"86fb3c3db3ce3d545a1cd6f774db5507edbb939068fa75eca5bf51c29146dbe6"} Jul 09 17:39:58.925543 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:58.925507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:39:58.925719 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:58.925653 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:39:59.926309 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:59.926278 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:39:59.926764 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:39:59.926278 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:39:59.926764 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:59.926385 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkf6h" podUID="bc115ae0-c011-4acd-b039-b5c116d7b412" Jul 09 17:39:59.926764 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:39:59.926506 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4tlr" podUID="79c29cb0-7adc-49ee-a3f6-d52c0c6efd68" Jul 09 17:40:00.645709 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:00.645676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:40:00.645709 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:00.645719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:00.645915 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.645828 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:40:00.645915 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.645884 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret podName:10ab9a00-7c69-4d92-a688-968b3ad604e7 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:32.645871315 +0000 UTC m=+66.391860222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret") pod "global-pull-secret-syncer-jphq7" (UID: "10ab9a00-7c69-4d92-a688-968b3ad604e7") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:40:00.645915 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.645828 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:40:00.646037 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.645954 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs podName:79c29cb0-7adc-49ee-a3f6-d52c0c6efd68 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:32.645942038 +0000 UTC m=+66.391930961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs") pod "network-metrics-daemon-v4tlr" (UID: "79c29cb0-7adc-49ee-a3f6-d52c0c6efd68") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:40:00.746982 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:00.746941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:00.747146 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.747122 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:40:00.747223 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.747148 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:40:00.747223 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.747158 2557 projected.go:196] Error preparing data for projected volume kube-api-access-ck5gk for pod openshift-network-diagnostics/network-check-target-bkf6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:40:00.747316 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.747256 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk podName:bc115ae0-c011-4acd-b039-b5c116d7b412 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:32.747226132 +0000 UTC m=+66.493215039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck5gk" (UniqueName: "kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk") pod "network-check-target-bkf6h" (UID: "bc115ae0-c011-4acd-b039-b5c116d7b412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:40:00.926343 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:00.926262 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:00.926780 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:00.926394 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jphq7" podUID="10ab9a00-7c69-4d92-a688-968b3ad604e7" Jul 09 17:40:01.262804 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.262762 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:01.369485 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.369281 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:01.524584 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.524509 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-252.ec2.internal" event="NodeReady" Jul 09 17:40:01.524739 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.524676 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 17:40:01.566236 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.566204 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:40:01.595711 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.595682 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-967gv"] Jul 09 17:40:01.595877 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.595821 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.600505 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.600476 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 17:40:01.601595 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.600791 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 17:40:01.601595 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.600816 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 17:40:01.608235 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.608209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48n2x\"" Jul 09 17:40:01.611819 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.611798 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fnmt7"] Jul 09 17:40:01.611926 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.611893 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 17:40:01.611988 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.611970 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.616675 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.616653 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 17:40:01.616843 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.616805 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-scpst\"" Jul 09 17:40:01.617399 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.617381 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 17:40:01.617493 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.617398 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 17:40:01.629735 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.629712 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:40:01.629735 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.629747 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-967gv"] Jul 09 17:40:01.629903 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.629768 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fnmt7"] Jul 09 17:40:01.629903 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.629874 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.633363 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.633343 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 17:40:01.633480 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.633350 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k2gp\"" Jul 09 17:40:01.633480 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.633412 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 17:40:01.755905 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.755867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.755905 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.755904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756130 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.755935 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756130 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756130 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756078 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcrq9\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccadb445-635f-49d8-9768-b283a79704b6-cert\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6e3e49-339f-4683-9b9e-d0037d72355a-config-volume\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6e3e49-339f-4683-9b9e-d0037d72355a-tmp-dir\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.756293 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4nnw\" (UniqueName: \"kubernetes.io/projected/4c6e3e49-339f-4683-9b9e-d0037d72355a-kube-api-access-x4nnw\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.756551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.756551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znqwq\" (UniqueName: \"kubernetes.io/projected/ccadb445-635f-49d8-9768-b283a79704b6-kube-api-access-znqwq\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.756551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.756383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.767698 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.767662 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:01.857392 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.857392 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857392 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccadb445-635f-49d8-9768-b283a79704b6-cert\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:01.857442 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:01.857513 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls podName:4c6e3e49-339f-4683-9b9e-d0037d72355a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:02.357494152 +0000 UTC m=+36.103483076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls") pod "dns-default-fnmt7" (UID: "4c6e3e49-339f-4683-9b9e-d0037d72355a") : secret "dns-default-metrics-tls" not found Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6e3e49-339f-4683-9b9e-d0037d72355a-config-volume\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6e3e49-339f-4683-9b9e-d0037d72355a-tmp-dir\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4nnw\" (UniqueName: \"kubernetes.io/projected/4c6e3e49-339f-4683-9b9e-d0037d72355a-kube-api-access-x4nnw\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znqwq\" (UniqueName: \"kubernetes.io/projected/ccadb445-635f-49d8-9768-b283a79704b6-kube-api-access-znqwq\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857787 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857814 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857851 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.857972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.857879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcrq9\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.858283 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.858032 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.858283 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.858100 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6e3e49-339f-4683-9b9e-d0037d72355a-config-volume\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.858283 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:01.858129 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 17:40:01.858283 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:01.858142 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c656cb5bb-grwzj: secret "image-registry-tls" not found Jul 09 17:40:01.858283 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:01.858224 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls podName:f02cb134-3eee-47b7-a00d-1b5952638c0c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:02.358207664 +0000 UTC m=+36.104196587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls") pod "image-registry-5c656cb5bb-grwzj" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c") : secret "image-registry-tls" not found Jul 09 17:40:01.858479 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.858336 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.858534 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.858515 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6e3e49-339f-4683-9b9e-d0037d72355a-tmp-dir\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.859095 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.859072 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.862395 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.862359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.862395 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.862375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.862554 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.862396 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccadb445-635f-49d8-9768-b283a79704b6-cert\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.867499 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.867382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:01.867642 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.867617 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcrq9\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.868312 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.868265 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znqwq\" (UniqueName: \"kubernetes.io/projected/ccadb445-635f-49d8-9768-b283a79704b6-kube-api-access-znqwq\") pod \"ingress-canary-967gv\" (UID: \"ccadb445-635f-49d8-9768-b283a79704b6\") " pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.868721 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.868704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:01.869294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.869269 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4nnw\" (UniqueName: \"kubernetes.io/projected/4c6e3e49-339f-4683-9b9e-d0037d72355a-kube-api-access-x4nnw\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:01.922038 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.921999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-967gv" Jul 09 17:40:01.926303 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.926273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:40:01.926441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.926319 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:01.929816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.929593 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 17:40:01.929816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.929610 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7kn9v\"" Jul 09 17:40:01.929816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.929666 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 17:40:01.929816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.929677 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59446\"" Jul 09 17:40:01.929816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:01.929612 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 17:40:02.350005 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:02.349982 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-967gv"] Jul 09 17:40:02.362315 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:02.362292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:02.362416 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:02.362359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:02.362451 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:02.362440 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 17:40:02.362480 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:02.362455 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c656cb5bb-grwzj: secret "image-registry-tls" not found Jul 09 17:40:02.362480 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:02.362463 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 17:40:02.362540 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:02.362509 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls podName:4c6e3e49-339f-4683-9b9e-d0037d72355a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.362492749 +0000 UTC m=+37.108481676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls") pod "dns-default-fnmt7" (UID: "4c6e3e49-339f-4683-9b9e-d0037d72355a") : secret "dns-default-metrics-tls" not found Jul 09 17:40:02.362540 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:02.362524 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls podName:f02cb134-3eee-47b7-a00d-1b5952638c0c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.362516426 +0000 UTC m=+37.108505335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls") pod "image-registry-5c656cb5bb-grwzj" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c") : secret "image-registry-tls" not found Jul 09 17:40:02.453575 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:02.453510 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccadb445_635f_49d8_9768_b283a79704b6.slice/crio-bfc0e16e1b29a19e18700779b94691771bd433cf5769b41a539ab46921398964 WatchSource:0}: Error finding container bfc0e16e1b29a19e18700779b94691771bd433cf5769b41a539ab46921398964: Status 404 returned error can't find the container with id bfc0e16e1b29a19e18700779b94691771bd433cf5769b41a539ab46921398964 Jul 09 17:40:02.926297 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:02.926257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:02.930255 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:02.930226 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 17:40:03.022645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.022545 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:03.113919 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.113886 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:03.175658 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.175624 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="8e9bd6b816c48b5cdbacb39b827b9ea494e2eea365791c7387d2323c6967bb7f" exitCode=0 Jul 09 17:40:03.175821 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.175678 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"8e9bd6b816c48b5cdbacb39b827b9ea494e2eea365791c7387d2323c6967bb7f"} Jul 09 17:40:03.177115 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.177093 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-967gv" event={"ID":"ccadb445-635f-49d8-9768-b283a79704b6","Type":"ContainerStarted","Data":"bfc0e16e1b29a19e18700779b94691771bd433cf5769b41a539ab46921398964"} Jul 09 17:40:03.208243 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.208131 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:03.332242 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.332206 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:03.370098 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.370045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:03.370282 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:03.370118 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:03.370282 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:03.370232 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 17:40:03.370282 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:03.370247 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 17:40:03.370282 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:03.370253 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c656cb5bb-grwzj: secret "image-registry-tls" not found Jul 09 17:40:03.370429 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:03.370319 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls podName:f02cb134-3eee-47b7-a00d-1b5952638c0c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:05.370298485 +0000 UTC m=+39.116287413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls") pod "image-registry-5c656cb5bb-grwzj" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c") : secret "image-registry-tls" not found Jul 09 17:40:03.370429 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:03.370341 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls podName:4c6e3e49-339f-4683-9b9e-d0037d72355a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:05.370331374 +0000 UTC m=+39.116320284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls") pod "dns-default-fnmt7" (UID: "4c6e3e49-339f-4683-9b9e-d0037d72355a") : secret "dns-default-metrics-tls" not found Jul 09 17:40:04.182898 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:04.182858 2557 generic.go:356] "Generic (PLEG): container finished" podID="40859ee7-b179-4bc9-ae44-022721d3be04" containerID="6b0b2124a0aaf72a96d8cd20215be385f9c22699da8371e7c456d234492c5e3f" exitCode=0 Jul 09 17:40:04.183316 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:04.182921 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerDied","Data":"6b0b2124a0aaf72a96d8cd20215be385f9c22699da8371e7c456d234492c5e3f"} Jul 09 17:40:05.187334 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.187116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-967gv" event={"ID":"ccadb445-635f-49d8-9768-b283a79704b6","Type":"ContainerStarted","Data":"f84b411351af0d07d3c14a71dff9fea626f3f28aee7a405301e52a2a3a1ec5e8"} Jul 09 17:40:05.190812 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.190784 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vts7" event={"ID":"40859ee7-b179-4bc9-ae44-022721d3be04","Type":"ContainerStarted","Data":"081680b8940d741409d8007ed9e35ac0757a90a289e568ffec5d4e1161017237"} Jul 09 17:40:05.207278 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.207235 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-967gv" podStartSLOduration=1.8785593999999999 podStartE2EDuration="4.207219684s" totalImagesPullingTime="2.328660284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:05.205874176 +0000 UTC m=+38.951863107" watchObservedRunningTime="2026-07-09 17:40:05.207219684 +0000 UTC m=+38.953208611" Jul 09 17:40:05.236666 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.236616 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5vts7" podStartSLOduration=9.031409766 podStartE2EDuration="38.236600711s" totalImagesPullingTime="29.205190945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:05.234208784 +0000 UTC m=+38.980197714" watchObservedRunningTime="2026-07-09 17:40:05.236600711 +0000 UTC m=+38.982589642" Jul 09 17:40:05.385917 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.385882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:05.386097 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:05.386034 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 17:40:05.386097 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.386040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:05.386097 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:05.386054 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c656cb5bb-grwzj: secret "image-registry-tls" not found Jul 09 17:40:05.386277 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:05.386105 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls podName:f02cb134-3eee-47b7-a00d-1b5952638c0c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:09.386091042 +0000 UTC m=+43.132079949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls") pod "image-registry-5c656cb5bb-grwzj" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c") : secret "image-registry-tls" not found Jul 09 17:40:05.386277 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:05.386163 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 17:40:05.386277 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:05.386236 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls podName:4c6e3e49-339f-4683-9b9e-d0037d72355a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:09.38622057 +0000 UTC m=+43.132209493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls") pod "dns-default-fnmt7" (UID: "4c6e3e49-339f-4683-9b9e-d0037d72355a") : secret "dns-default-metrics-tls" not found Jul 09 17:40:05.390633 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.390606 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:05.491036 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.490958 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:05.589812 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:05.589778 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.020775 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.020738 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.122472 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.122437 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.486307 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.486276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.642204 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.642154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.764371 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.764288 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:06.998487 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:06.998453 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:07.156110 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:07.156046 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:07.437756 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:07.437662 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:07.631976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:07.631944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:08.088097 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.088069 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gz4jw"] Jul 09 17:40:08.104450 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.104409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.109646 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.109627 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 17:40:08.109646 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.109638 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 17:40:08.109779 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.109641 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 17:40:08.111000 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.110985 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4s5jj\"" Jul 09 17:40:08.111053 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.110982 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 17:40:08.122327 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.122307 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gz4jw"] Jul 09 17:40:08.153280 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.153251 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:08.206524 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.206495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4ba093-2319-4aa9-862d-5eef84b04f52-crio-socket\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.206680 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.206537 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.206680 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.206592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjnvt\" (UniqueName: \"kubernetes.io/projected/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-api-access-qjnvt\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.206680 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.206615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4ba093-2319-4aa9-862d-5eef84b04f52-data-volume\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.206782 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.206682 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.266422 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.266390 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:08.307321 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4ba093-2319-4aa9-862d-5eef84b04f52-data-volume\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307355 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307379 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4ba093-2319-4aa9-862d-5eef84b04f52-crio-socket\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjnvt\" (UniqueName: \"kubernetes.io/projected/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-api-access-qjnvt\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.307490 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 17:40:08.307627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.307562 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:08.807539894 +0000 UTC m=+42.553528817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : configmap "kube-rbac-proxy" not found Jul 09 17:40:08.307627 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.307614 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 17:40:08.307750 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307613 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4ba093-2319-4aa9-862d-5eef84b04f52-crio-socket\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307750 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.307614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4ba093-2319-4aa9-862d-5eef84b04f52-data-volume\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.307750 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.307686 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:08.807667152 +0000 UTC m=+42.553656076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : secret "insights-runtime-extractor-tls" not found Jul 09 17:40:08.328343 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.328318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjnvt\" (UniqueName: \"kubernetes.io/projected/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-api-access-qjnvt\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.810614 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.810567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.810976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:08.810661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:08.810976 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.810675 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 17:40:08.810976 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.810725 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 17:40:08.810976 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.810738 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:09.810724331 +0000 UTC m=+43.556713239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : secret "insights-runtime-extractor-tls" not found Jul 09 17:40:08.810976 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:08.810764 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:09.810752731 +0000 UTC m=+43.556741638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : configmap "kube-rbac-proxy" not found Jul 09 17:40:09.064417 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.064321 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:09.190420 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.190381 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:09.416360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.416318 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:09.416517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.416400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:09.416517 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.416487 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 17:40:09.416517 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.416504 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c656cb5bb-grwzj: secret "image-registry-tls" not found Jul 09 17:40:09.416652 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.416552 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls podName:f02cb134-3eee-47b7-a00d-1b5952638c0c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:17.41653857 +0000 UTC m=+51.162527481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls") pod "image-registry-5c656cb5bb-grwzj" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c") : secret "image-registry-tls" not found Jul 09 17:40:09.416652 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.416492 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 17:40:09.416652 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.416603 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls podName:4c6e3e49-339f-4683-9b9e-d0037d72355a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:17.416592184 +0000 UTC m=+51.162581092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls") pod "dns-default-fnmt7" (UID: "4c6e3e49-339f-4683-9b9e-d0037d72355a") : secret "dns-default-metrics-tls" not found Jul 09 17:40:09.481187 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.481135 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:09.601553 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.601521 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:09.819432 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.819342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:09.819432 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:09.819398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:09.819830 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.819463 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 17:40:09.819830 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.819518 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 17:40:09.819830 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.819530 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:11.819515283 +0000 UTC m=+45.565504190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : configmap "kube-rbac-proxy" not found Jul 09 17:40:09.819830 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:09.819587 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:11.819575961 +0000 UTC m=+45.565564868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : secret "insights-runtime-extractor-tls" not found Jul 09 17:40:10.254142 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:10.254103 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:10.963700 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:10.963674 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sbfkc_26ca39a8-3520-421b-b6d6-6baa0d462e68/dns-node-resolver/0.log" Jul 09 17:40:11.835987 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:11.835946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:11.836255 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:11.836002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:11.836255 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:11.836073 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 17:40:11.836255 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:11.836135 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 17:40:11.836255 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:11.836136 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.83611942 +0000 UTC m=+49.582108343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : configmap "kube-rbac-proxy" not found Jul 09 17:40:11.836255 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:11.836197 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.836186677 +0000 UTC m=+49.582175585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : secret "insights-runtime-extractor-tls" not found Jul 09 17:40:11.972159 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:11.972134 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf696_b01c638e-f844-41c7-9591-bf021acc560c/node-ca/0.log" Jul 09 17:40:12.360284 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:12.360250 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-967gv_ccadb445-635f-49d8-9768-b283a79704b6/serve-healthcheck-canary/0.log" Jul 09 17:40:13.769218 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:13.769161 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:13.875691 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:13.875651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:14.041936 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:14.041851 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:14.141900 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:14.141848 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:14.249684 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:14.249651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:14.496106 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:14.496070 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:15.058889 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:15.058857 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:15.662751 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:15.662693 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:15.868421 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:15.868378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:15.868612 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:15.868551 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 17:40:15.868612 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:15.868569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:15.868720 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:15.868626 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:23.868606058 +0000 UTC m=+57.614594969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : secret "insights-runtime-extractor-tls" not found Jul 09 17:40:15.868720 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:15.868655 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 17:40:15.868720 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:15.868711 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm podName:0b4ba093-2319-4aa9-862d-5eef84b04f52 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:23.868698508 +0000 UTC m=+57.614687416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gz4jw" (UID: "0b4ba093-2319-4aa9-862d-5eef84b04f52") : configmap "kube-rbac-proxy" not found Jul 09 17:40:16.064365 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:16.064272 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:16.264226 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:16.264188 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:16.655560 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:16.655521 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:17.070629 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.070547 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:17.462189 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.462125 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:17.483300 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.483258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:17.483459 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.483369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:17.485627 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.485604 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c6e3e49-339f-4683-9b9e-d0037d72355a-metrics-tls\") pod \"dns-default-fnmt7\" (UID: \"4c6e3e49-339f-4683-9b9e-d0037d72355a\") " pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:17.485711 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.485677 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"image-registry-5c656cb5bb-grwzj\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:17.511647 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.511605 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:17.539184 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.539148 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:17.670285 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.670239 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:40:17.673901 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.673872 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:17.674064 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:17.674042 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02cb134_3eee_47b7_a00d_1b5952638c0c.slice/crio-0bdcebdc4a57c0fd757663b6a66af323b176c891c17b4ecee60dae9f04efcd32 WatchSource:0}: Error finding container 0bdcebdc4a57c0fd757663b6a66af323b176c891c17b4ecee60dae9f04efcd32: Status 404 returned error can't find the container with id 0bdcebdc4a57c0fd757663b6a66af323b176c891c17b4ecee60dae9f04efcd32 Jul 09 17:40:17.691449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.691406 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fnmt7"] Jul 09 17:40:17.713153 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:17.713131 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6e3e49_339f_4683_9b9e_d0037d72355a.slice/crio-626c4c469fb6e571c9eca0625970e640be1daea8db90e945d5180d31ed81500a WatchSource:0}: Error finding container 626c4c469fb6e571c9eca0625970e640be1daea8db90e945d5180d31ed81500a: Status 404 returned error can't find the container with id 626c4c469fb6e571c9eca0625970e640be1daea8db90e945d5180d31ed81500a Jul 09 17:40:17.773019 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.772988 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:17.873229 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:17.873188 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:18.065405 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.065333 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:18.126289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.126255 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:18.223995 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.223955 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnmt7" event={"ID":"4c6e3e49-339f-4683-9b9e-d0037d72355a","Type":"ContainerStarted","Data":"626c4c469fb6e571c9eca0625970e640be1daea8db90e945d5180d31ed81500a"} Jul 09 17:40:18.225782 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.225750 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" event={"ID":"f02cb134-3eee-47b7-a00d-1b5952638c0c","Type":"ContainerStarted","Data":"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe"} Jul 09 17:40:18.225914 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.225803 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" event={"ID":"f02cb134-3eee-47b7-a00d-1b5952638c0c","Type":"ContainerStarted","Data":"0bdcebdc4a57c0fd757663b6a66af323b176c891c17b4ecee60dae9f04efcd32"} Jul 09 17:40:18.225914 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.225895 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:18.249022 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:18.248964 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" podStartSLOduration=18.248947038 podStartE2EDuration="18.248947038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:18.24864793 +0000 UTC m=+51.994636862" watchObservedRunningTime="2026-07-09 17:40:18.248947038 +0000 UTC m=+51.994935967" Jul 09 17:40:19.062745 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:19.062700 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:19.476073 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:19.476034 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:19.903598 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:19.903534 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:20.006030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.005888 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:20.105289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.105252 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:20.164750 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.164722 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:20.233087 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.233055 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnmt7" event={"ID":"4c6e3e49-339f-4683-9b9e-d0037d72355a","Type":"ContainerStarted","Data":"62f1daa76cad7e8b85f7e9fa5c3329e1bdcf8ad73245df4e5d629a33f92480de"} Jul 09 17:40:20.233278 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.233137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnmt7" event={"ID":"4c6e3e49-339f-4683-9b9e-d0037d72355a","Type":"ContainerStarted","Data":"9d7afbe7db05c992cb62bd9b49fd34f589adaea5750d2234d74d2f67db764c3c"} Jul 09 17:40:20.233332 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.233277 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:20.253711 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.253664 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fnmt7" podStartSLOduration=17.291200787 podStartE2EDuration="19.253649037s" totalImagesPullingTime="1.96244825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:20.252152031 +0000 UTC m=+53.998140961" watchObservedRunningTime="2026-07-09 17:40:20.253649037 +0000 UTC m=+53.999637946" Jul 09 17:40:20.681601 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:20.681564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:21.066865 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:21.066759 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:21.671162 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:21.671126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:21.891884 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:21.891847 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:22.064398 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:22.064289 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:22.165771 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:22.165735 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:22.265735 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:22.265702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:22.462621 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:22.462565 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:22.873703 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:22.873671 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.288620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.288522 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.389520 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.389487 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.490586 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.490554 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.596682 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.596599 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.690895 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.690861 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.794310 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.794276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.893979 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.893952 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:23.932999 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.932962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:23.933216 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.933020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:23.933551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.933530 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4ba093-2319-4aa9-862d-5eef84b04f52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:23.935314 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:23.935294 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4ba093-2319-4aa9-862d-5eef84b04f52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz4jw\" (UID: \"0b4ba093-2319-4aa9-862d-5eef84b04f52\") " pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:24.014498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.014458 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gz4jw" Jul 09 17:40:24.057770 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.057741 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:24.168211 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.168093 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:24.181559 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.181530 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gz4jw"] Jul 09 17:40:24.184526 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:24.184505 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4ba093_2319_4aa9_862d_5eef84b04f52.slice/crio-3e852896674abfbb258b1fe681a26694711f50dafa697212ba8cd3929402decd WatchSource:0}: Error finding container 3e852896674abfbb258b1fe681a26694711f50dafa697212ba8cd3929402decd: Status 404 returned error can't find the container with id 3e852896674abfbb258b1fe681a26694711f50dafa697212ba8cd3929402decd Jul 09 17:40:24.244469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.244430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz4jw" event={"ID":"0b4ba093-2319-4aa9-862d-5eef84b04f52","Type":"ContainerStarted","Data":"3e852896674abfbb258b1fe681a26694711f50dafa697212ba8cd3929402decd"} Jul 09 17:40:24.269198 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.269154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:24.369953 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.369923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:24.471756 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.471675 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:24.563231 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:24.563193 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:25.025089 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:25.025049 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:25.224356 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:25.224308 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:25.600933 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:25.600898 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:25.697560 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:25.697524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:27.163059 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:27.163030 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpzmp" Jul 09 17:40:28.257341 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:28.257307 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz4jw" event={"ID":"0b4ba093-2319-4aa9-862d-5eef84b04f52","Type":"ContainerStarted","Data":"700801d4be23805c86be78c1610d3d356e197e70596870f415df33c211480c59"} Jul 09 17:40:29.262148 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:29.262108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz4jw" event={"ID":"0b4ba093-2319-4aa9-862d-5eef84b04f52","Type":"ContainerStarted","Data":"20edeb58e0df51af6f1927e211d038e8cd45d64d928e0a57c224eb6a8aa1b58b"} Jul 09 17:40:30.237230 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:30.237200 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fnmt7" Jul 09 17:40:31.269549 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:31.269514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz4jw" event={"ID":"0b4ba093-2319-4aa9-862d-5eef84b04f52","Type":"ContainerStarted","Data":"5ed0771763d69fa893691a554ca617b533918cd80c670bf14b506a3903e6a591"} Jul 09 17:40:31.292837 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:31.292776 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gz4jw" podStartSLOduration=17.461515003 podStartE2EDuration="24.292761402s" totalImagesPullingTime="6.831246399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:40:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:31.29221012 +0000 UTC m=+65.038199049" watchObservedRunningTime="2026-07-09 17:40:31.292761402 +0000 UTC m=+65.038750331" Jul 09 17:40:32.702036 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.701990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:40:32.702036 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.702035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:32.705247 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.705227 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 17:40:32.705344 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.705323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 17:40:32.714864 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.714832 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10ab9a00-7c69-4d92-a688-968b3ad604e7-original-pull-secret\") pod \"global-pull-secret-syncer-jphq7\" (UID: \"10ab9a00-7c69-4d92-a688-968b3ad604e7\") " pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:32.714966 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.714924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79c29cb0-7adc-49ee-a3f6-d52c0c6efd68-metrics-certs\") pod \"network-metrics-daemon-v4tlr\" (UID: \"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68\") " pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:40:32.803279 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.803239 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:32.806800 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.806776 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 17:40:32.817697 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.817670 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 17:40:32.826514 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.826491 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5gk\" (UniqueName: \"kubernetes.io/projected/bc115ae0-c011-4acd-b039-b5c116d7b412-kube-api-access-ck5gk\") pod \"network-check-target-bkf6h\" (UID: \"bc115ae0-c011-4acd-b039-b5c116d7b412\") " pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:32.841335 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.841313 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7kn9v\"" Jul 09 17:40:32.846386 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.846368 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59446\"" Jul 09 17:40:32.848846 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.848833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4tlr" Jul 09 17:40:32.854210 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.854194 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:32.956529 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.956497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jphq7" Jul 09 17:40:32.988320 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:32.988292 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4tlr"] Jul 09 17:40:32.990825 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:32.990788 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c29cb0_7adc_49ee_a3f6_d52c0c6efd68.slice/crio-8238d3b61ff809cef354aa5a406f84c8031a9bf1ff4e0ef6974deddf85d8495c WatchSource:0}: Error finding container 8238d3b61ff809cef354aa5a406f84c8031a9bf1ff4e0ef6974deddf85d8495c: Status 404 returned error can't find the container with id 8238d3b61ff809cef354aa5a406f84c8031a9bf1ff4e0ef6974deddf85d8495c Jul 09 17:40:33.004803 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.004782 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkf6h"] Jul 09 17:40:33.008594 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:33.008560 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc115ae0_c011_4acd_b039_b5c116d7b412.slice/crio-38dbe6fee48b133427d9f952511e784d2f73217d3cd4d8757115cdb7ead11e99 WatchSource:0}: Error finding container 38dbe6fee48b133427d9f952511e784d2f73217d3cd4d8757115cdb7ead11e99: Status 404 returned error can't find the container with id 38dbe6fee48b133427d9f952511e784d2f73217d3cd4d8757115cdb7ead11e99 Jul 09 17:40:33.083599 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.083568 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jphq7"] Jul 09 17:40:33.086629 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:33.086604 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ab9a00_7c69_4d92_a688_968b3ad604e7.slice/crio-9a68453ff729cd135ae6eab7c1f9043bd73d3d4c785e4598b151cb829de4773a WatchSource:0}: Error finding container 9a68453ff729cd135ae6eab7c1f9043bd73d3d4c785e4598b151cb829de4773a: Status 404 returned error can't find the container with id 9a68453ff729cd135ae6eab7c1f9043bd73d3d4c785e4598b151cb829de4773a Jul 09 17:40:33.276829 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.276732 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4tlr" event={"ID":"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68","Type":"ContainerStarted","Data":"8238d3b61ff809cef354aa5a406f84c8031a9bf1ff4e0ef6974deddf85d8495c"} Jul 09 17:40:33.277857 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.277822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkf6h" event={"ID":"bc115ae0-c011-4acd-b039-b5c116d7b412","Type":"ContainerStarted","Data":"38dbe6fee48b133427d9f952511e784d2f73217d3cd4d8757115cdb7ead11e99"} Jul 09 17:40:33.278820 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.278798 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jphq7" event={"ID":"10ab9a00-7c69-4d92-a688-968b3ad604e7","Type":"ContainerStarted","Data":"9a68453ff729cd135ae6eab7c1f9043bd73d3d4c785e4598b151cb829de4773a"} Jul 09 17:40:33.642940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.642903 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-kwfl8"] Jul 09 17:40:33.645204 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.645071 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:33.649655 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.649436 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 17:40:33.649864 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.649838 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:40:33.650143 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.650083 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4tn4f\"" Jul 09 17:40:33.650143 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.650130 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 17:40:33.660449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.660397 2557 patch_prober.go:28] interesting pod/image-registry-5c656cb5bb-grwzj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 17:40:33.660571 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.660443 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:40:33.661533 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.661507 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kwfl8"] Jul 09 17:40:33.709320 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.709278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2424j\" (UniqueName: \"kubernetes.io/projected/6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79-kube-api-access-2424j\") pod \"downloads-68c9cbb497-kwfl8\" (UID: \"6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79\") " pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:33.810073 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.810033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2424j\" (UniqueName: \"kubernetes.io/projected/6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79-kube-api-access-2424j\") pod \"downloads-68c9cbb497-kwfl8\" (UID: \"6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79\") " pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:33.811410 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.811371 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:33.823035 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.823008 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2424j\" (UniqueName: \"kubernetes.io/projected/6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79-kube-api-access-2424j\") pod \"downloads-68c9cbb497-kwfl8\" (UID: \"6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79\") " pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:33.961668 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:33.961574 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:34.000907 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.000871 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:34.148707 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.148678 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:34.181603 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.181575 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kwfl8"] Jul 09 17:40:34.185961 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:34.185928 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7a78b0_3ebc_4fc7_9a08_b3b7a8170d79.slice/crio-2813b24e4295d630fb85504a1295d82953ee8b7a2c78ff4effb64df3473681e6 WatchSource:0}: Error finding container 2813b24e4295d630fb85504a1295d82953ee8b7a2c78ff4effb64df3473681e6: Status 404 returned error can't find the container with id 2813b24e4295d630fb85504a1295d82953ee8b7a2c78ff4effb64df3473681e6 Jul 09 17:40:34.271895 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.271856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:34.285412 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.285342 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kwfl8" event={"ID":"6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79","Type":"ContainerStarted","Data":"2813b24e4295d630fb85504a1295d82953ee8b7a2c78ff4effb64df3473681e6"} Jul 09 17:40:34.288233 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.287501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4tlr" event={"ID":"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68","Type":"ContainerStarted","Data":"e5d5830eb8aac6a51d760d6a16ad17ae2d17b2d94a6c12ff98ba5f732addad55"} Jul 09 17:40:34.288233 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.287551 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4tlr" event={"ID":"79c29cb0-7adc-49ee-a3f6-d52c0c6efd68","Type":"ContainerStarted","Data":"9964a22c4edf0bde6f227384d1c35c948d6d217afeb2f62498c4e0e9151b2b8a"} Jul 09 17:40:34.862960 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.862921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:34.985987 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:34.985910 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:35.109568 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.109231 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v4tlr" podStartSLOduration=67.045843271 podStartE2EDuration="1m8.109205271s" totalImagesPullingTime="1.063362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:34.334095029 +0000 UTC m=+68.080083965" watchObservedRunningTime="2026-07-09 17:40:35.109205271 +0000 UTC m=+68.855194212" Jul 09 17:40:35.109930 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.109900 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js"] Jul 09 17:40:35.112057 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.112036 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:35.116878 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.116719 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:35.118470 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.118418 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v5pft\"" Jul 09 17:40:35.118644 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.118626 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 17:40:35.136612 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.136585 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js"] Jul 09 17:40:35.221965 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.221926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1c457ab8-33e4-485a-8fc0-0498eea1fd4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j22js\" (UID: \"1c457ab8-33e4-485a-8fc0-0498eea1fd4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:35.232358 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.232245 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:35.302213 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.302133 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:35.322902 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.322865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1c457ab8-33e4-485a-8fc0-0498eea1fd4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j22js\" (UID: \"1c457ab8-33e4-485a-8fc0-0498eea1fd4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:35.329748 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.329722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1c457ab8-33e4-485a-8fc0-0498eea1fd4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j22js\" (UID: \"1c457ab8-33e4-485a-8fc0-0498eea1fd4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:35.425825 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.425737 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:35.553464 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.553372 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:35.635497 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:35.635445 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:38.581139 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.580321 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:40:38.595341 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.595302 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:40:38.595454 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.595419 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.600461 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.600427 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 17:40:38.602692 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.602669 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 17:40:38.602936 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.602920 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 17:40:38.603145 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.603126 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 17:40:38.603454 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.603436 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4qw2\"" Jul 09 17:40:38.603809 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.603652 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 17:40:38.645851 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lcq\" (UniqueName: \"kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.645851 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.646083 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.646083 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.646083 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645905 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.646083 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.645926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.733316 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.733278 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js"] Jul 09 17:40:38.736649 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:38.736618 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c457ab8_33e4_485a_8fc0_0498eea1fd4f.slice/crio-6dada4881933e21f5b2a69e56199d0cad5b5bcc99e284dad162b5ab91ba5369f WatchSource:0}: Error finding container 6dada4881933e21f5b2a69e56199d0cad5b5bcc99e284dad162b5ab91ba5369f: Status 404 returned error can't find the container with id 6dada4881933e21f5b2a69e56199d0cad5b5bcc99e284dad162b5ab91ba5369f Jul 09 17:40:38.747075 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lcq\" (UniqueName: \"kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.747226 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.747226 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.747226 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.747226 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747217 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.747437 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.747253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.748291 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.748264 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.748415 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.748393 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.748634 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.748550 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.750115 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.750095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.750426 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.750408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.758505 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.758468 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lcq\" (UniqueName: \"kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq\") pod \"console-7f8f88b98c-k6fdq\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:38.918936 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:38.918895 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:39.087722 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.087678 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:40:39.092250 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:39.092217 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78208faf_60f3_440a_9aeb_f9c7e5bb1cce.slice/crio-60e891a53866971ef3396afc253033746d036950a4a64b8592542cd1165730da WatchSource:0}: Error finding container 60e891a53866971ef3396afc253033746d036950a4a64b8592542cd1165730da: Status 404 returned error can't find the container with id 60e891a53866971ef3396afc253033746d036950a4a64b8592542cd1165730da Jul 09 17:40:39.260361 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.260244 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:39.309666 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.309618 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkf6h" event={"ID":"bc115ae0-c011-4acd-b039-b5c116d7b412","Type":"ContainerStarted","Data":"92d16ef28ec0ea4f4bdd45e12e3890f600f5ee0b7608113c755a5c8f250a8d57"} Jul 09 17:40:39.309878 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.309738 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:40:39.311595 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.311545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jphq7" event={"ID":"10ab9a00-7c69-4d92-a688-968b3ad604e7","Type":"ContainerStarted","Data":"b83a8a0d2353fd4106931a1db04720b6aedb18bdd7a5d381e0b1c9da15eefbe0"} Jul 09 17:40:39.312916 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.312886 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f88b98c-k6fdq" event={"ID":"78208faf-60f3-440a-9aeb-f9c7e5bb1cce","Type":"ContainerStarted","Data":"60e891a53866971ef3396afc253033746d036950a4a64b8592542cd1165730da"} Jul 09 17:40:39.314408 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.314383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" event={"ID":"1c457ab8-33e4-485a-8fc0-0498eea1fd4f","Type":"ContainerStarted","Data":"6dada4881933e21f5b2a69e56199d0cad5b5bcc99e284dad162b5ab91ba5369f"} Jul 09 17:40:39.330676 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.330617 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bkf6h" podStartSLOduration=66.774020643 podStartE2EDuration="1m12.330597457s" totalImagesPullingTime="5.556576814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:39.329773253 +0000 UTC m=+73.075762184" watchObservedRunningTime="2026-07-09 17:40:39.330597457 +0000 UTC m=+73.076586387" Jul 09 17:40:39.355294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.355190 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jphq7" podStartSLOduration=66.859310454 podStartE2EDuration="1m12.355156553s" totalImagesPullingTime="5.495846099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:39.354767642 +0000 UTC m=+73.100756573" watchObservedRunningTime="2026-07-09 17:40:39.355156553 +0000 UTC m=+73.101145478" Jul 09 17:40:39.371319 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.371232 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:39.666599 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.666545 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:39.747708 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:39.747672 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:40.320801 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:40.320752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" event={"ID":"1c457ab8-33e4-485a-8fc0-0498eea1fd4f","Type":"ContainerStarted","Data":"78eea40270f5bc7f04d844d6a4f2cd0c5ecdd2ff57baf6eab4b0e623ee56cc4f"} Jul 09 17:40:40.344464 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:40.344286 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" podStartSLOduration=4.285828219 podStartE2EDuration="5.344263444s" totalImagesPullingTime="1.058435225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:40.342492774 +0000 UTC m=+74.088481698" watchObservedRunningTime="2026-07-09 17:40:40.344263444 +0000 UTC m=+74.090252375" Jul 09 17:40:40.430094 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:40.430048 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:40.506836 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:40.506798 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:41.325826 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:41.325796 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:41.332141 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:41.332114 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j22js" Jul 09 17:40:41.643063 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:41.643028 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:41.757149 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:41.757112 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:42.115464 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.115426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:42.185847 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.185809 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbrxf"] Jul 09 17:40:42.191788 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.191760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.197827 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.197803 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 17:40:42.199517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.199275 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 17:40:42.199517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.199326 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 17:40:42.199517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.199420 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 17:40:42.202987 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.202966 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6kdjv\"" Jul 09 17:40:42.203555 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.203527 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 17:40:42.206700 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.206675 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbrxf"] Jul 09 17:40:42.212732 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.212699 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:42.275255 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.275217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s6x7\" (UniqueName: \"kubernetes.io/projected/f8b2e4ea-3950-4334-bc29-48760e402ede-kube-api-access-9s6x7\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.275255 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.275261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.275489 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.275283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2e4ea-3950-4334-bc29-48760e402ede-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.275489 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.275385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.330988 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.330899 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f88b98c-k6fdq" event={"ID":"78208faf-60f3-440a-9aeb-f9c7e5bb1cce","Type":"ContainerStarted","Data":"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f"} Jul 09 17:40:42.354414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.354351 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8f88b98c-k6fdq" podStartSLOduration=1.416851079 podStartE2EDuration="4.354329955s" totalImagesPullingTime="2.937478876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:42.353998802 +0000 UTC m=+76.099987728" watchObservedRunningTime="2026-07-09 17:40:42.354329955 +0000 UTC m=+76.100318886" Jul 09 17:40:42.376408 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.376371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.376570 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.376521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s6x7\" (UniqueName: \"kubernetes.io/projected/f8b2e4ea-3950-4334-bc29-48760e402ede-kube-api-access-9s6x7\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.376643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.376569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.376643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.376598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2e4ea-3950-4334-bc29-48760e402ede-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.377548 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.377524 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2e4ea-3950-4334-bc29-48760e402ede-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.379232 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.379206 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.379466 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.379441 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8b2e4ea-3950-4334-bc29-48760e402ede-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.387854 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.387826 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s6x7\" (UniqueName: \"kubernetes.io/projected/f8b2e4ea-3950-4334-bc29-48760e402ede-kube-api-access-9s6x7\") pod \"prometheus-operator-64785b6675-pbrxf\" (UID: \"f8b2e4ea-3950-4334-bc29-48760e402ede\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.501843 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.501798 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" Jul 09 17:40:42.637785 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.637751 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbrxf"] Jul 09 17:40:42.641042 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:42.641004 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b2e4ea_3950_4334_bc29_48760e402ede.slice/crio-1e9a827f0d43643c24926070cd0d1fa5af86493d28c6ef0377e55cde1422c63d WatchSource:0}: Error finding container 1e9a827f0d43643c24926070cd0d1fa5af86493d28c6ef0377e55cde1422c63d: Status 404 returned error can't find the container with id 1e9a827f0d43643c24926070cd0d1fa5af86493d28c6ef0377e55cde1422c63d Jul 09 17:40:42.809526 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.809486 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:42.883710 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:42.883668 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:43.336694 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.336597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" event={"ID":"f8b2e4ea-3950-4334-bc29-48760e402ede","Type":"ContainerStarted","Data":"1e9a827f0d43643c24926070cd0d1fa5af86493d28c6ef0377e55cde1422c63d"} Jul 09 17:40:43.631511 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.631467 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:43.655330 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.655294 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:43.732667 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.732633 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:43.864009 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.863954 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:43.989427 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:43.989398 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:44.277906 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:44.277819 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:44.343010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:44.342970 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" event={"ID":"f8b2e4ea-3950-4334-bc29-48760e402ede","Type":"ContainerStarted","Data":"b05bf51f2ad3484f203030a7b951feeba158aff267e32856eb8e1d1def692f29"} Jul 09 17:40:44.343441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:44.343028 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" event={"ID":"f8b2e4ea-3950-4334-bc29-48760e402ede","Type":"ContainerStarted","Data":"ad5a09e52b4b0db82f67c5eada12dc6d400bf915c77ee6d9cdf01e7f1c78c378"} Jul 09 17:40:44.363651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:44.363596 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-pbrxf" podStartSLOduration=1.034425535 podStartE2EDuration="2.363574294s" totalImagesPullingTime="1.329148759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:44.362138275 +0000 UTC m=+78.108127204" watchObservedRunningTime="2026-07-09 17:40:44.363574294 +0000 UTC m=+78.109563225" Jul 09 17:40:45.616044 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:45.615988 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:45.677800 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:45.677759 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:46.327224 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.327157 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:46.578388 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.578293 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:46.600013 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.599981 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d"] Jul 09 17:40:46.602888 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.602860 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.607756 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.607729 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 17:40:46.607880 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.607802 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lpg9v\"" Jul 09 17:40:46.608040 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.608021 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 17:40:46.619490 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.619465 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d"] Jul 09 17:40:46.706670 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.706636 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z97kp"] Jul 09 17:40:46.710090 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.710057 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.711248 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.710897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70a64e3-4b53-4533-bb89-94a9a2f8e496-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.711248 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.710944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphpq\" (UniqueName: \"kubernetes.io/projected/b70a64e3-4b53-4533-bb89-94a9a2f8e496-kube-api-access-pphpq\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.711248 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.710991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.711248 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.711046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.714471 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.714442 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 17:40:46.715549 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.715530 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 17:40:46.716158 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.716137 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vtjz5\"" Jul 09 17:40:46.716259 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.716138 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 17:40:46.755871 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.755829 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:46.812092 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812062 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.812290 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvd7v\" (UniqueName: \"kubernetes.io/projected/4a677ad3-7341-416f-a4cb-92073f468c1e-kube-api-access-gvd7v\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812290 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-textfile\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812290 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-root\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-sys\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812350 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70a64e3-4b53-4533-bb89-94a9a2f8e496-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.812469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-tls\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812588 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-wtmp\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812588 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphpq\" (UniqueName: \"kubernetes.io/projected/b70a64e3-4b53-4533-bb89-94a9a2f8e496-kube-api-access-pphpq\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.812690 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.812690 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812617 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812690 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-metrics-client-ca\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812825 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:46.812700 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 17:40:46.812825 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.812700 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.812825 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:46.812780 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls podName:b70a64e3-4b53-4533-bb89-94a9a2f8e496 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:47.312758829 +0000 UTC m=+81.058747757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-vfl7d" (UID: "b70a64e3-4b53-4533-bb89-94a9a2f8e496") : secret "openshift-state-metrics-tls" not found Jul 09 17:40:46.813126 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.813105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70a64e3-4b53-4533-bb89-94a9a2f8e496-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.814758 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.814736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.824128 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.824104 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphpq\" (UniqueName: \"kubernetes.io/projected/b70a64e3-4b53-4533-bb89-94a9a2f8e496-kube-api-access-pphpq\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:46.914186 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-tls\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914363 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914312 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-wtmp\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914434 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914383 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914434 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-metrics-client-ca\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvd7v\" (UniqueName: \"kubernetes.io/projected/4a677ad3-7341-416f-a4cb-92073f468c1e-kube-api-access-gvd7v\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-textfile\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-root\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-sys\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914635 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-root\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914825 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914781 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-sys\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.914910 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.914883 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-textfile\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.915088 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.915065 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-wtmp\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.915163 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.915125 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.915368 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.915337 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a677ad3-7341-416f-a4cb-92073f468c1e-metrics-client-ca\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.917140 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.917117 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-tls\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.917363 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.917341 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a677ad3-7341-416f-a4cb-92073f468c1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:46.928641 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:46.928615 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvd7v\" (UniqueName: \"kubernetes.io/projected/4a677ad3-7341-416f-a4cb-92073f468c1e-kube-api-access-gvd7v\") pod \"node-exporter-z97kp\" (UID: \"4a677ad3-7341-416f-a4cb-92073f468c1e\") " pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:47.005965 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.005926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:47.023078 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.023045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z97kp" Jul 09 17:40:47.100720 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.100684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:47.261054 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.260969 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:47.318091 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.318053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:47.320846 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.320820 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70a64e3-4b53-4533-bb89-94a9a2f8e496-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-vfl7d\" (UID: \"b70a64e3-4b53-4533-bb89-94a9a2f8e496\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:47.368728 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.368693 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:47.513365 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.513283 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" Jul 09 17:40:47.710360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.710324 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:47.868050 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:47.868010 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:48.097599 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:48.097463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:48.919961 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:48.919722 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:48.919961 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:48.919839 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:48.930468 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:48.930443 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:49.370287 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.370258 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:40:49.710973 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.710888 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:49.823237 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.823207 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6685bfcdf-2qwlz"] Jul 09 17:40:49.853254 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.853201 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:49.931545 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.931458 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:49.951944 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.951909 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6685bfcdf-2qwlz"] Jul 09 17:40:49.952104 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.952037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:49.957338 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.957312 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eobrpp59v9dv1\"" Jul 09 17:40:49.957478 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.957360 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 17:40:49.957478 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.957312 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 17:40:49.957589 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.957578 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 17:40:49.958448 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.958356 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 17:40:49.958448 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.958390 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 17:40:49.958638 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:49.958453 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jwvk5\"" Jul 09 17:40:50.040194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-grpc-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040139 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsnm\" (UniqueName: \"kubernetes.io/projected/d0981033-568f-4760-8c7b-293995886d6f-kube-api-access-bdsnm\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040442 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0981033-568f-4760-8c7b-293995886d6f-metrics-client-ca\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040442 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040442 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040442 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.040584 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.040457 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.132079 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.132042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:50.141720 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141683 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141720 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsnm\" (UniqueName: \"kubernetes.io/projected/d0981033-568f-4760-8c7b-293995886d6f-kube-api-access-bdsnm\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0981033-568f-4760-8c7b-293995886d6f-metrics-client-ca\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.141964 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.141952 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-grpc-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.142686 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.142662 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0981033-568f-4760-8c7b-293995886d6f-metrics-client-ca\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.144985 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.144954 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.144985 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.144977 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.145383 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.145358 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.145473 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.145410 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-grpc-tls\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.145528 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.145469 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.145624 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.145608 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0981033-568f-4760-8c7b-293995886d6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.154553 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.154528 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsnm\" (UniqueName: \"kubernetes.io/projected/d0981033-568f-4760-8c7b-293995886d6f-kube-api-access-bdsnm\") pod \"thanos-querier-6685bfcdf-2qwlz\" (UID: \"d0981033-568f-4760-8c7b-293995886d6f\") " pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.263269 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.263231 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:50.398113 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:50.398076 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:51.177297 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.177261 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84b58f995c-z4k8t"] Jul 09 17:40:51.250421 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.250387 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84b58f995c-z4k8t"] Jul 09 17:40:51.250585 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.250505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.256774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.256747 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 17:40:51.256924 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.256752 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 17:40:51.257419 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.257059 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 17:40:51.257419 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.257077 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 17:40:51.257419 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.257089 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ek7ksrlc1vleg\"" Jul 09 17:40:51.257419 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.257373 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vd8zr\"" Jul 09 17:40:51.345768 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.345725 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:51.354015 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.353974 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354202 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-client-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354202 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354054 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-audit-log\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354202 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354139 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-client-certs\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354364 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-tls\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354364 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm9xd\" (UniqueName: \"kubernetes.io/projected/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-kube-api-access-mm9xd\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.354364 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.354319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-metrics-server-audit-profiles\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.447152 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.447065 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:51.456187 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456144 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456349 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-client-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456349 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-audit-log\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456349 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-client-certs\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456349 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-tls\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456569 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm9xd\" (UniqueName: \"kubernetes.io/projected/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-kube-api-access-mm9xd\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456569 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-metrics-server-audit-profiles\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456713 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-audit-log\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.456977 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.456952 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.457561 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.457538 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-metrics-server-audit-profiles\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.459211 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.459188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-client-ca-bundle\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.459330 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.459277 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-client-certs\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.459393 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.459332 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-secret-metrics-server-tls\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.465444 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.465422 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm9xd\" (UniqueName: \"kubernetes.io/projected/63f942a8-44d9-4fe6-8453-5aef44a9d2b2-kube-api-access-mm9xd\") pod \"metrics-server-84b58f995c-z4k8t\" (UID: \"63f942a8-44d9-4fe6-8453-5aef44a9d2b2\") " pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.546728 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.546674 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:51.561703 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.561669 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:40:51.571772 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:51.571730 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a677ad3_7341_416f_a4cb_92073f468c1e.slice/crio-531396b08c06f59d58aae71e844eb33b3684ff586eb91b523d77c71f2089d99e WatchSource:0}: Error finding container 531396b08c06f59d58aae71e844eb33b3684ff586eb91b523d77c71f2089d99e: Status 404 returned error can't find the container with id 531396b08c06f59d58aae71e844eb33b3684ff586eb91b523d77c71f2089d99e Jul 09 17:40:51.717551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.717526 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d"] Jul 09 17:40:51.720090 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:51.720064 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70a64e3_4b53_4533_bb89_94a9a2f8e496.slice/crio-522427fd682dab26fd003f7a0a8e53e89828ed1d409d86b18685ed92cd46934f WatchSource:0}: Error finding container 522427fd682dab26fd003f7a0a8e53e89828ed1d409d86b18685ed92cd46934f: Status 404 returned error can't find the container with id 522427fd682dab26fd003f7a0a8e53e89828ed1d409d86b18685ed92cd46934f Jul 09 17:40:51.740263 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.740107 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6685bfcdf-2qwlz"] Jul 09 17:40:51.760851 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:51.760823 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84b58f995c-z4k8t"] Jul 09 17:40:51.889927 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:51.889788 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0981033_568f_4760_8c7b_293995886d6f.slice/crio-32caf13044c7f2365dcef7b3c5771ddead3082198afc181dcc568448caced9c3 WatchSource:0}: Error finding container 32caf13044c7f2365dcef7b3c5771ddead3082198afc181dcc568448caced9c3: Status 404 returned error can't find the container with id 32caf13044c7f2365dcef7b3c5771ddead3082198afc181dcc568448caced9c3 Jul 09 17:40:51.890445 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:40:51.890423 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f942a8_44d9_4fe6_8453_5aef44a9d2b2.slice/crio-749d84b6d35b611597847c7aacb4d83ac2e9ce90fba9c94cc0624e04242a475f WatchSource:0}: Error finding container 749d84b6d35b611597847c7aacb4d83ac2e9ce90fba9c94cc0624e04242a475f: Status 404 returned error can't find the container with id 749d84b6d35b611597847c7aacb4d83ac2e9ce90fba9c94cc0624e04242a475f Jul 09 17:40:52.153859 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.153818 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:52.252395 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.252307 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:52.379651 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.379611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" event={"ID":"63f942a8-44d9-4fe6-8453-5aef44a9d2b2","Type":"ContainerStarted","Data":"749d84b6d35b611597847c7aacb4d83ac2e9ce90fba9c94cc0624e04242a475f"} Jul 09 17:40:52.382565 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.382427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"32caf13044c7f2365dcef7b3c5771ddead3082198afc181dcc568448caced9c3"} Jul 09 17:40:52.391468 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.391412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" event={"ID":"b70a64e3-4b53-4533-bb89-94a9a2f8e496","Type":"ContainerStarted","Data":"6ac88c2cb29e106efed4e8c054e7037933a9526c20ad3ea508d5606156731326"} Jul 09 17:40:52.391609 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.391481 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" event={"ID":"b70a64e3-4b53-4533-bb89-94a9a2f8e496","Type":"ContainerStarted","Data":"6f50d0d80bb77770c730aa6ac15a5ea3a31b2a448675a663e853659ae6b4fb5d"} Jul 09 17:40:52.391609 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.391514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" event={"ID":"b70a64e3-4b53-4533-bb89-94a9a2f8e496","Type":"ContainerStarted","Data":"522427fd682dab26fd003f7a0a8e53e89828ed1d409d86b18685ed92cd46934f"} Jul 09 17:40:52.395243 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.394635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kwfl8" event={"ID":"6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79","Type":"ContainerStarted","Data":"5cb0ef6174fb2a3587a6711ff9800a9ce3b44039e5a8de2e90d9b2db6d65416c"} Jul 09 17:40:52.395243 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.394990 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:52.397712 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.397156 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z97kp" event={"ID":"4a677ad3-7341-416f-a4cb-92073f468c1e","Type":"ContainerStarted","Data":"531396b08c06f59d58aae71e844eb33b3684ff586eb91b523d77c71f2089d99e"} Jul 09 17:40:52.405492 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.405467 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-kwfl8" Jul 09 17:40:52.417856 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:52.417793 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-kwfl8" podStartSLOduration=1.618294796 podStartE2EDuration="19.417772182s" totalImagesPullingTime="17.799477386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:52.416226174 +0000 UTC m=+86.162215105" watchObservedRunningTime="2026-07-09 17:40:52.417772182 +0000 UTC m=+86.163761115" Jul 09 17:40:53.079001 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:53.076062 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:53.203989 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:53.203948 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:53.365289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:53.361862 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:56.416821 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.416783 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" event={"ID":"63f942a8-44d9-4fe6-8453-5aef44a9d2b2","Type":"ContainerStarted","Data":"f647adda820450b4dbabfa4521f982aa806666ec5514a4ab9a2135e3e83fecaa"} Jul 09 17:40:56.419539 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.419508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"6a341a58b071c788b8f4f0c30f73e21cd0558176d720d142375d6a32ec98976d"} Jul 09 17:40:56.419700 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.419584 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"f22cba56759921d608c66622bd5e7dacd0e53436483e3418c08d186c2419fc4b"} Jul 09 17:40:56.419700 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.419632 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"95897ffe7c4ce26fe3dd036da05cc2610c0bd1160055ee1887c401e17c0304af"} Jul 09 17:40:56.422086 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.422056 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" event={"ID":"b70a64e3-4b53-4533-bb89-94a9a2f8e496","Type":"ContainerStarted","Data":"fa9afbb0c9a8153744e0d5375d8271a4b3bf09e78bd828ac94ddd239b61f65eb"} Jul 09 17:40:56.424241 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.424214 2557 generic.go:356] "Generic (PLEG): container finished" podID="4a677ad3-7341-416f-a4cb-92073f468c1e" containerID="1042f10b864c141b6ee51cd0b5e8bd266387ac1044fbb53b9dffe062eda7fa23" exitCode=0 Jul 09 17:40:56.424368 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.424264 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z97kp" event={"ID":"4a677ad3-7341-416f-a4cb-92073f468c1e","Type":"ContainerDied","Data":"1042f10b864c141b6ee51cd0b5e8bd266387ac1044fbb53b9dffe062eda7fa23"} Jul 09 17:40:56.457370 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.457307 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" podStartSLOduration=1.633447305 podStartE2EDuration="5.457287886s" totalImagesPullingTime="3.823840581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:56.454222698 +0000 UTC m=+90.200211642" watchObservedRunningTime="2026-07-09 17:40:56.457287886 +0000 UTC m=+90.203276817" Jul 09 17:40:56.490321 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.490253 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-vfl7d" podStartSLOduration=6.874325548 podStartE2EDuration="10.49023411s" totalImagesPullingTime="3.615908562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:56.488143151 +0000 UTC m=+90.234132095" watchObservedRunningTime="2026-07-09 17:40:56.49023411 +0000 UTC m=+90.236223043" Jul 09 17:40:56.579692 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.579656 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:56.696991 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.696903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:56.803995 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:56.803959 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:57.431247 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:57.431200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z97kp" event={"ID":"4a677ad3-7341-416f-a4cb-92073f468c1e","Type":"ContainerStarted","Data":"02aa7162ea08f3e7b7c6053ab3260d240bf8df1c19e337df7076f60bff0a5912"} Jul 09 17:40:57.431814 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:57.431273 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z97kp" event={"ID":"4a677ad3-7341-416f-a4cb-92073f468c1e","Type":"ContainerStarted","Data":"7cf7efafd62612d1d45aacb46f7a505246a3280196308b4d3d576969c3b491e6"} Jul 09 17:40:57.457161 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:57.457104 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z97kp" podStartSLOduration=7.166790369 podStartE2EDuration="11.45708413s" totalImagesPullingTime="4.165069934s" totalInitContainerRuntime="125.223827ms" isStatefulPod=true podCreationTimestamp="2026-07-09 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:57.453144393 +0000 UTC m=+91.199133323" watchObservedRunningTime="2026-07-09 17:40:57.45708413 +0000 UTC m=+91.203073061" Jul 09 17:40:58.439636 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.439591 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"c6b74cc96b82ffa65126ab46493b517eae24a58068acf3d6f7f9b12719f7bb26"} Jul 09 17:40:58.440224 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.439719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"93bc2bca7660dc8c106df83c6f85b1cea9f19366436a85fa7123d4acddc0299a"} Jul 09 17:40:58.440224 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.439754 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" event={"ID":"d0981033-568f-4760-8c7b-293995886d6f","Type":"ContainerStarted","Data":"f127465d281900680f05034604f6f53313ccd045a1bbac218e91d1e0980bab78"} Jul 09 17:40:58.467762 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.467702 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" podStartSLOduration=4.305629333 podStartE2EDuration="9.467679802s" totalImagesPullingTime="5.162050469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:58.465070935 +0000 UTC m=+92.211059929" watchObservedRunningTime="2026-07-09 17:40:58.467679802 +0000 UTC m=+92.213668734" Jul 09 17:40:58.608711 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.608671 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:58.679779 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.679740 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerName="registry" containerID="cri-o://f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe" gracePeriod=30 Jul 09 17:40:58.710740 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.710630 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:40:58.987681 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:58.987608 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:59.129684 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129639 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.129919 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129712 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.129919 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129743 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.129919 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129796 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.130076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129916 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.130076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.129972 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.130076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.130024 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcrq9\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.130076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.130058 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") pod \"f02cb134-3eee-47b7-a00d-1b5952638c0c\" (UID: \"f02cb134-3eee-47b7-a00d-1b5952638c0c\") " Jul 09 17:40:59.130780 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.130722 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:40:59.130900 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.130806 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:40:59.133809 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.133778 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:40:59.133938 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.133865 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:40:59.134101 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.134071 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9" (OuterVolumeSpecName: "kube-api-access-kcrq9") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "kube-api-access-kcrq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:40:59.134374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.134263 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:40:59.134374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.134340 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:40:59.141186 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.141149 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f02cb134-3eee-47b7-a00d-1b5952638c0c" (UID: "f02cb134-3eee-47b7-a00d-1b5952638c0c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:40:59.230683 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230648 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcrq9\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-kube-api-access-kcrq9\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230683 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230678 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-tls\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230683 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230691 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02cb134-3eee-47b7-a00d-1b5952638c0c-ca-trust-extracted\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230705 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-installation-pull-secrets\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230720 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02cb134-3eee-47b7-a00d-1b5952638c0c-image-registry-private-configuration\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230729 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-trusted-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230737 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02cb134-3eee-47b7-a00d-1b5952638c0c-bound-sa-token\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.230937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.230744 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02cb134-3eee-47b7-a00d-1b5952638c0c-registry-certificates\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:40:59.444896 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.444856 2557 generic.go:356] "Generic (PLEG): container finished" podID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerID="f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe" exitCode=0 Jul 09 17:40:59.444896 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.444904 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" Jul 09 17:40:59.445424 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.444952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" event={"ID":"f02cb134-3eee-47b7-a00d-1b5952638c0c","Type":"ContainerDied","Data":"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe"} Jul 09 17:40:59.445424 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.445011 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c656cb5bb-grwzj" event={"ID":"f02cb134-3eee-47b7-a00d-1b5952638c0c","Type":"ContainerDied","Data":"0bdcebdc4a57c0fd757663b6a66af323b176c891c17b4ecee60dae9f04efcd32"} Jul 09 17:40:59.445424 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.445043 2557 scope.go:117] "RemoveContainer" containerID="f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe" Jul 09 17:40:59.446080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.445583 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:40:59.458745 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.458723 2557 scope.go:117] "RemoveContainer" containerID="f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe" Jul 09 17:40:59.459087 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:40:59.459061 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe\": container with ID starting with f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe not found: ID does not exist" containerID="f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe" Jul 09 17:40:59.459215 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.459090 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe"} err="failed to get container status \"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe\": rpc error: code = NotFound desc = could not find container \"f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe\": container with ID starting with f94699675300f589ac807aeb91d3f96be08af2ddf28eab8302c4e00d57dc7bbe not found: ID does not exist" Jul 09 17:40:59.474932 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.474907 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:40:59.481631 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:40:59.481601 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c656cb5bb-grwzj"] Jul 09 17:41:00.930354 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:00.930322 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" path="/var/lib/kubelet/pods/f02cb134-3eee-47b7-a00d-1b5952638c0c/volumes" Jul 09 17:41:02.580550 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:02.580510 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:41:02.699780 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:02.699746 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:02.797695 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:02.797659 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:02.858114 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:02.858029 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:04.228402 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:04.228368 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:04.302769 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:04.302736 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:05.457195 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:05.457104 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6685bfcdf-2qwlz" Jul 09 17:41:07.150151 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:07.150105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:07.249717 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:07.249683 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:10.323979 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:10.323951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bkf6h" Jul 09 17:41:11.562216 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:11.562161 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:41:11.562659 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:11.562244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:41:19.362971 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:19.362931 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:19.428054 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:19.428020 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:22.159444 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:22.159406 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:22.271614 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:22.271578 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:27.344610 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.344564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:27.409814 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.409782 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:27.601642 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.601539 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8f88b98c-k6fdq" podUID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" containerName="console" containerID="cri-o://71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f" gracePeriod=15 Jul 09 17:41:27.881951 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.881916 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:41:27.956638 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956606 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.956833 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956658 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.956833 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956686 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.956833 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956710 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.957004 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956860 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.957004 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.956918 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9lcq\" (UniqueName: \"kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq\") pod \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\" (UID: \"78208faf-60f3-440a-9aeb-f9c7e5bb1cce\") " Jul 09 17:41:27.957103 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.957078 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config" (OuterVolumeSpecName: "console-config") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:41:27.957103 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.957087 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca" (OuterVolumeSpecName: "service-ca") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:41:27.957217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.957153 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:27.957217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.957195 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:27.957217 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.957204 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:41:27.959010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.958979 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq" (OuterVolumeSpecName: "kube-api-access-k9lcq") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "kube-api-access-k9lcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:41:27.959117 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.959037 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:41:27.959117 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:27.959058 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78208faf-60f3-440a-9aeb-f9c7e5bb1cce" (UID: "78208faf-60f3-440a-9aeb-f9c7e5bb1cce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:41:28.058249 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.058212 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:28.058249 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.058242 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:28.058249 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.058251 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9lcq\" (UniqueName: \"kubernetes.io/projected/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-kube-api-access-k9lcq\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:28.058249 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.058260 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78208faf-60f3-440a-9aeb-f9c7e5bb1cce-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:41:28.556075 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.556038 2557 generic.go:356] "Generic (PLEG): container finished" podID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" containerID="71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f" exitCode=0 Jul 09 17:41:28.556075 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.556078 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f88b98c-k6fdq" Jul 09 17:41:28.556532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.556122 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f88b98c-k6fdq" event={"ID":"78208faf-60f3-440a-9aeb-f9c7e5bb1cce","Type":"ContainerDied","Data":"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f"} Jul 09 17:41:28.556532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.556190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f88b98c-k6fdq" event={"ID":"78208faf-60f3-440a-9aeb-f9c7e5bb1cce","Type":"ContainerDied","Data":"60e891a53866971ef3396afc253033746d036950a4a64b8592542cd1165730da"} Jul 09 17:41:28.556532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.556214 2557 scope.go:117] "RemoveContainer" containerID="71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f" Jul 09 17:41:28.564298 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.564282 2557 scope.go:117] "RemoveContainer" containerID="71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f" Jul 09 17:41:28.564582 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:41:28.564561 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f\": container with ID starting with 71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f not found: ID does not exist" containerID="71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f" Jul 09 17:41:28.564646 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.564589 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f"} err="failed to get container status \"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f\": rpc error: code = NotFound desc = could not find container \"71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f\": container with ID starting with 71fab674f315f72e14659308e651bcdd21c231d02788f1a0254496748d09cb6f not found: ID does not exist" Jul 09 17:41:28.577270 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.577250 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:41:28.580680 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.580659 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8f88b98c-k6fdq"] Jul 09 17:41:28.930554 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:28.930521 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" path="/var/lib/kubelet/pods/78208faf-60f3-440a-9aeb-f9c7e5bb1cce/volumes" Jul 09 17:41:31.567245 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:31.567214 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:41:31.571077 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:31.571009 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84b58f995c-z4k8t" Jul 09 17:41:38.260365 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:38.260313 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:38.360742 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:38.360706 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:42.327712 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:42.327675 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:42.875245 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:42.875208 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:41:42.949720 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:41:42.949675 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:06.216874 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:06.216834 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:06.384799 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:06.384765 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:08.853501 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853460 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853737 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerName="registry" Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853747 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerName="registry" Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853756 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" containerName="console" Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853761 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" containerName="console" Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853819 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="78208faf-60f3-440a-9aeb-f9c7e5bb1cce" containerName="console" Jul 09 17:42:08.853893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.853829 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02cb134-3eee-47b7-a00d-1b5952638c0c" containerName="registry" Jul 09 17:42:08.857740 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.857716 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.861294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.861267 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 17:42:08.861294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.861268 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 17:42:08.861447 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.861432 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vvmbg\"" Jul 09 17:42:08.861697 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.861680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 17:42:08.862511 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.862493 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 17:42:08.862647 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.862508 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 17:42:08.862724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.862513 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 17:42:08.862724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.862514 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 17:42:08.862724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.862574 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 17:42:08.870913 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.869152 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 17:42:08.875246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.875222 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:42:08.971076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971076 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-config-out\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-web-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971296 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971393 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:08.971645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:08.971494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qhn\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-kube-api-access-g6qhn\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072363 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072363 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072367 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072604 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qhn\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-kube-api-access-g6qhn\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-config-out\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072807 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.072940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.072838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-web-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.074577 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.074545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.074832 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.074806 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cc27fa-9db1-4500-b057-8a513120ccf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.075728 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.075701 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-web-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.075807 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.075709 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.075929 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.075894 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cc27fa-9db1-4500-b057-8a513120ccf3-config-out\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.076133 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.076064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.076261 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.076166 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.076419 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.076395 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.076504 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.076484 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.077492 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.077475 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21cc27fa-9db1-4500-b057-8a513120ccf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.077567 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.077529 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.082990 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.082967 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qhn\" (UniqueName: \"kubernetes.io/projected/21cc27fa-9db1-4500-b057-8a513120ccf3-kube-api-access-g6qhn\") pod \"alertmanager-main-0\" (UID: \"21cc27fa-9db1-4500-b057-8a513120ccf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.166839 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.166806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:42:09.306277 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.306205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:42:09.309048 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:42:09.309006 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cc27fa_9db1_4500_b057_8a513120ccf3.slice/crio-9ae27aaae29d4884ebc570288c694fee08b3d5bc4e84d91811bb179a7fe5d96d WatchSource:0}: Error finding container 9ae27aaae29d4884ebc570288c694fee08b3d5bc4e84d91811bb179a7fe5d96d: Status 404 returned error can't find the container with id 9ae27aaae29d4884ebc570288c694fee08b3d5bc4e84d91811bb179a7fe5d96d Jul 09 17:42:09.711058 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:09.711025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"9ae27aaae29d4884ebc570288c694fee08b3d5bc4e84d91811bb179a7fe5d96d"} Jul 09 17:42:10.720093 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:10.720056 2557 generic.go:356] "Generic (PLEG): container finished" podID="21cc27fa-9db1-4500-b057-8a513120ccf3" containerID="566c802720ab9222f84d14e292912a5e96bfd64fbb90b14609bd6a9e95b009fd" exitCode=0 Jul 09 17:42:10.720093 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:10.720097 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerDied","Data":"566c802720ab9222f84d14e292912a5e96bfd64fbb90b14609bd6a9e95b009fd"} Jul 09 17:42:11.409760 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.409725 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd"] Jul 09 17:42:11.412482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.412460 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.416608 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.416580 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 17:42:11.417110 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.417085 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p9rnx\"" Jul 09 17:42:11.417236 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.417143 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 17:42:11.417236 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.417156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 17:42:11.417236 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.417156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 17:42:11.417769 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.417735 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 17:42:11.422218 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.422195 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 17:42:11.429819 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.429794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd"] Jul 09 17:42:11.494000 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.493955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-serving-certs-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494194 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494340 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjtcs\" (UniqueName: \"kubernetes.io/projected/b705aa28-1ada-4cde-bece-c9527a919c5e-kube-api-access-gjtcs\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494340 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-federate-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.494340 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.494304 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-metrics-client-ca\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.594993 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.594962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-metrics-client-ca\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.595205 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-serving-certs-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.595205 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.595205 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.595205 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.595496 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.596759 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595530 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjtcs\" (UniqueName: \"kubernetes.io/projected/b705aa28-1ada-4cde-bece-c9527a919c5e-kube-api-access-gjtcs\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.596759 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.595576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-federate-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.596759 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.596123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-metrics-client-ca\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.596759 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.596435 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-serving-certs-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.596759 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.596662 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.598231 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.598182 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.598489 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.598469 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-telemeter-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.598570 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.598499 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-federate-client-tls\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.598629 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.598562 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b705aa28-1ada-4cde-bece-c9527a919c5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.604454 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.604431 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjtcs\" (UniqueName: \"kubernetes.io/projected/b705aa28-1ada-4cde-bece-c9527a919c5e-kube-api-access-gjtcs\") pod \"telemeter-client-dc6dc7bc5-8dxhd\" (UID: \"b705aa28-1ada-4cde-bece-c9527a919c5e\") " pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.723974 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.723884 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" Jul 09 17:42:11.890450 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:11.890412 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd"] Jul 09 17:42:12.169620 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:42:12.169578 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb705aa28_1ada_4cde_bece_c9527a919c5e.slice/crio-5915051715a44bb149c558981d7054abc679ce7f8b9b8cab82e3e116a08d261f WatchSource:0}: Error finding container 5915051715a44bb149c558981d7054abc679ce7f8b9b8cab82e3e116a08d261f: Status 404 returned error can't find the container with id 5915051715a44bb149c558981d7054abc679ce7f8b9b8cab82e3e116a08d261f Jul 09 17:42:12.732493 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.732398 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" event={"ID":"b705aa28-1ada-4cde-bece-c9527a919c5e","Type":"ContainerStarted","Data":"5915051715a44bb149c558981d7054abc679ce7f8b9b8cab82e3e116a08d261f"} Jul 09 17:42:12.736271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736241 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"47b72a0a6267b0594e1f84b128eed0f19c8505aa83981fcd2db7b89bba2fbcc6"} Jul 09 17:42:12.736414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736302 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"a7fee62c64669290bf67190e14c29638d00d1f52d63b951a58af3b8351e4927b"} Jul 09 17:42:12.736414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736330 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"e46951c1b9e8cbec57a804fa4e8d74914797a49ff550c666ef1889e240505dab"} Jul 09 17:42:12.736414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"a7911e75de717e8d64ec315784fc452987d98a250a2b2c623d813df1c8bb4366"} Jul 09 17:42:12.736414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736410 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"462a0f17bc5e50edb4fb96497f239630db08bb8196b3774f3afda6d492e3f391"} Jul 09 17:42:12.736623 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.736450 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21cc27fa-9db1-4500-b057-8a513120ccf3","Type":"ContainerStarted","Data":"2e1f4677c036a3272862874bc1394a276b5cbfadf755741ee84f603db8b0e214"} Jul 09 17:42:12.767629 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:12.767563 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.265038106 podStartE2EDuration="4.767543443s" totalImagesPullingTime="2.48532307s" totalInitContainerRuntime="17.182267ms" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:12.766029483 +0000 UTC m=+166.512018414" watchObservedRunningTime="2026-07-09 17:42:12.767543443 +0000 UTC m=+166.513532374" Jul 09 17:42:14.750457 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:14.750419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" event={"ID":"b705aa28-1ada-4cde-bece-c9527a919c5e","Type":"ContainerStarted","Data":"5079f9fb30c84412004fe7f2812dbdcec58c5595de30ddfa41a78e9cea6ad8ec"} Jul 09 17:42:14.750825 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:14.750477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" event={"ID":"b705aa28-1ada-4cde-bece-c9527a919c5e","Type":"ContainerStarted","Data":"c13e94c04bc4218c612ce9195e2acf86bbf56ed31f23eec0cdf1631d6f04ec81"} Jul 09 17:42:14.750825 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:14.750497 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" event={"ID":"b705aa28-1ada-4cde-bece-c9527a919c5e","Type":"ContainerStarted","Data":"7e7e5458034c5280cc4366331f3c55cd8eb255d1c544582f77bda81bcbebbcf3"} Jul 09 17:42:14.776672 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:14.776601 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dc6dc7bc5-8dxhd" podStartSLOduration=2.2497922790000002 podStartE2EDuration="3.776585026s" totalImagesPullingTime="1.526792747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:14.776480107 +0000 UTC m=+168.522469038" watchObservedRunningTime="2026-07-09 17:42:14.776585026 +0000 UTC m=+168.522573956" Jul 09 17:42:15.804308 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.804273 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:42:15.806548 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.806531 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.809961 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.809938 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 17:42:15.811413 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.811394 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 17:42:15.811696 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.811678 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4qw2\"" Jul 09 17:42:15.811779 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.811750 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 17:42:15.813134 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.813087 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 17:42:15.813319 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.813303 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 17:42:15.822010 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.821980 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 17:42:15.823840 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.823816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:42:15.881618 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.881587 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:15.934937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.934897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.934937 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.934944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcvd\" (UniqueName: \"kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.935139 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.935019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.935139 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.935062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.935139 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.935097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.935139 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.935131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:15.935321 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:15.935212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.009300 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.009268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:16.036327 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036327 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036421 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.036488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.036471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcvd\" (UniqueName: \"kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.037120 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.037095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.037270 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.037140 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.037270 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.037200 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.037470 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.037454 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.038940 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.038912 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.039019 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.038912 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.044981 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.044961 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcvd\" (UniqueName: \"kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd\") pod \"console-56dbb87865-kfpm2\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.121815 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.121782 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:16.254927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.254902 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:42:16.256975 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:42:16.256935 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf46f421_3e8b_45b8_bea9_5a6d0468198b.slice/crio-d6927bda7946a1ae5140a2e09ef86c347ceb073ff1550d9b6c265f0aa2e7eaa5 WatchSource:0}: Error finding container d6927bda7946a1ae5140a2e09ef86c347ceb073ff1550d9b6c265f0aa2e7eaa5: Status 404 returned error can't find the container with id d6927bda7946a1ae5140a2e09ef86c347ceb073ff1550d9b6c265f0aa2e7eaa5 Jul 09 17:42:16.760459 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.760429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbb87865-kfpm2" event={"ID":"af46f421-3e8b-45b8-bea9-5a6d0468198b","Type":"ContainerStarted","Data":"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6"} Jul 09 17:42:16.760643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.760474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbb87865-kfpm2" event={"ID":"af46f421-3e8b-45b8-bea9-5a6d0468198b","Type":"ContainerStarted","Data":"d6927bda7946a1ae5140a2e09ef86c347ceb073ff1550d9b6c265f0aa2e7eaa5"} Jul 09 17:42:16.780121 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:16.780068 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dbb87865-kfpm2" podStartSLOduration=1.780051007 podStartE2EDuration="1.780051007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:16.779113086 +0000 UTC m=+170.525102018" watchObservedRunningTime="2026-07-09 17:42:16.780051007 +0000 UTC m=+170.526039937" Jul 09 17:42:26.122845 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:26.122798 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:26.123294 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:26.122893 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:26.127947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:26.127923 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:26.800472 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:26.800442 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:42:27.067138 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:27.067051 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:42:27.167537 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:42:27.167499 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:13.024627 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:13.024590 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:13.077687 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:13.077650 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:21.558944 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:21.558907 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:21.629590 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:21.629556 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:22.264331 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.264297 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:43:22.267510 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.267493 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.279602 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.279574 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:43:22.326980 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.326943 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:22.387645 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387792 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s76pn\" (UniqueName: \"kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387792 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387792 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387792 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387957 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.387957 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.387855 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.389058 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.389033 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:22.488526 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s76pn\" (UniqueName: \"kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488526 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488759 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.488968 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.488845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.489463 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.489430 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.489463 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.489457 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.489463 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.489468 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.489691 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.489582 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.491195 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.491157 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.491253 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.491231 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.496912 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.496883 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s76pn\" (UniqueName: \"kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn\") pod \"console-7959c6469f-xphxr\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.576532 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.576441 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:22.660829 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.660780 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:22.706920 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:22.706889 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:43:22.710516 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:43:22.710488 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0950abea_9dbd_4f73_b833_810197aa1581.slice/crio-d3071a4bf3a07c9316565d9882a91a9daf5d924c9c6a068a2399553455a85b33 WatchSource:0}: Error finding container d3071a4bf3a07c9316565d9882a91a9daf5d924c9c6a068a2399553455a85b33: Status 404 returned error can't find the container with id d3071a4bf3a07c9316565d9882a91a9daf5d924c9c6a068a2399553455a85b33 Jul 09 17:43:23.005737 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:23.005702 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7959c6469f-xphxr" event={"ID":"0950abea-9dbd-4f73-b833-810197aa1581","Type":"ContainerStarted","Data":"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5"} Jul 09 17:43:23.005917 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:23.005763 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7959c6469f-xphxr" event={"ID":"0950abea-9dbd-4f73-b833-810197aa1581","Type":"ContainerStarted","Data":"d3071a4bf3a07c9316565d9882a91a9daf5d924c9c6a068a2399553455a85b33"} Jul 09 17:43:23.028013 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:23.027953 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7959c6469f-xphxr" podStartSLOduration=1.027936757 podStartE2EDuration="1.027936757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:43:23.026876408 +0000 UTC m=+236.772865338" watchObservedRunningTime="2026-07-09 17:43:23.027936757 +0000 UTC m=+236.773925687" Jul 09 17:43:32.577049 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:32.576994 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:32.577472 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:32.577075 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:32.581726 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:32.581702 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:33.046820 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.046789 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:43:33.101106 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.101066 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:43:33.214313 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.214275 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:33.315026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.314924 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:33.415289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.415251 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:33.535858 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.535812 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:33.637457 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:33.637423 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:37.146314 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:37.146278 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:37.314838 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:37.314795 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:40.642927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:40.642892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:40.739992 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:40.739957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:56.764018 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:56.763921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:56.821894 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:56.821852 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:57.684260 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.684225 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:57.697314 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.697288 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2"] Jul 09 17:43:57.700571 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.700557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.703468 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.703450 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 17:43:57.704916 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.704901 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l9txs\"" Jul 09 17:43:57.705227 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.705209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 17:43:57.705300 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.705261 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 17:43:57.705346 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.705310 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 17:43:57.709060 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.709034 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2"] Jul 09 17:43:57.762492 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.762463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0dc752-59d2-4e3c-94ec-944210af8c54-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.762643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.762541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2p4\" (UniqueName: \"kubernetes.io/projected/0d0dc752-59d2-4e3c-94ec-944210af8c54-kube-api-access-qw2p4\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.781629 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.781592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:57.785180 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.785145 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm"] Jul 09 17:43:57.788274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.788254 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.791454 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.791438 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 17:43:57.801106 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.801082 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm"] Jul 09 17:43:57.863132 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkll\" (UniqueName: \"kubernetes.io/projected/7ee0501b-7116-4063-a65a-4b4d04b01c58-kube-api-access-rqkll\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.863132 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2p4\" (UniqueName: \"kubernetes.io/projected/0d0dc752-59d2-4e3c-94ec-944210af8c54-kube-api-access-qw2p4\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.863404 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0dc752-59d2-4e3c-94ec-944210af8c54-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.863404 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee0501b-7116-4063-a65a-4b4d04b01c58-tmp\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.863404 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ee0501b-7116-4063-a65a-4b4d04b01c58-klusterlet-config\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.863853 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.863829 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:43:57.866001 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.865976 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0dc752-59d2-4e3c-94ec-944210af8c54-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.872699 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.872680 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2p4\" (UniqueName: \"kubernetes.io/projected/0d0dc752-59d2-4e3c-94ec-944210af8c54-kube-api-access-qw2p4\") pod \"managed-serviceaccount-addon-agent-9b7446f56-z9bw2\" (UID: \"0d0dc752-59d2-4e3c-94ec-944210af8c54\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:57.964628 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.964549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee0501b-7116-4063-a65a-4b4d04b01c58-tmp\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.964628 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.964595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ee0501b-7116-4063-a65a-4b4d04b01c58-klusterlet-config\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.964628 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.964626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkll\" (UniqueName: \"kubernetes.io/projected/7ee0501b-7116-4063-a65a-4b4d04b01c58-kube-api-access-rqkll\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.964946 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.964925 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee0501b-7116-4063-a65a-4b4d04b01c58-tmp\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.966954 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.966926 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ee0501b-7116-4063-a65a-4b4d04b01c58-klusterlet-config\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:57.973538 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:57.973503 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkll\" (UniqueName: \"kubernetes.io/projected/7ee0501b-7116-4063-a65a-4b4d04b01c58-kube-api-access-rqkll\") pod \"klusterlet-addon-workmgr-8586597bf-vrjtm\" (UID: \"7ee0501b-7116-4063-a65a-4b4d04b01c58\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:58.024482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.024437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" Jul 09 17:43:58.097750 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.097483 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:43:58.127930 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.127858 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56dbb87865-kfpm2" podUID="af46f421-3e8b-45b8-bea9-5a6d0468198b" containerName="console" containerID="cri-o://3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6" gracePeriod=15 Jul 09 17:43:58.171393 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.171368 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2"] Jul 09 17:43:58.189228 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:43:58.189192 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d0dc752_59d2_4e3c_94ec_944210af8c54.slice/crio-70bdc6065393b2c8c7acd24f5c013cb2d81899a3c5e36023bfba76c6c189091c WatchSource:0}: Error finding container 70bdc6065393b2c8c7acd24f5c013cb2d81899a3c5e36023bfba76c6c189091c: Status 404 returned error can't find the container with id 70bdc6065393b2c8c7acd24f5c013cb2d81899a3c5e36023bfba76c6c189091c Jul 09 17:43:58.232554 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.232532 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm"] Jul 09 17:43:58.235016 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:43:58.234988 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee0501b_7116_4063_a65a_4b4d04b01c58.slice/crio-fce5ad0e0e30d769be382854f79dbfd6834f77f6c3a1900609fdde92d084f93e WatchSource:0}: Error finding container fce5ad0e0e30d769be382854f79dbfd6834f77f6c3a1900609fdde92d084f93e: Status 404 returned error can't find the container with id fce5ad0e0e30d769be382854f79dbfd6834f77f6c3a1900609fdde92d084f93e Jul 09 17:43:58.358040 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.358011 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:43:58.468871 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.468841 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469068 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.468892 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469068 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.468917 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469068 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.468942 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469068 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469040 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469312 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469078 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztcvd\" (UniqueName: \"kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469312 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469108 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca\") pod \"af46f421-3e8b-45b8-bea9-5a6d0468198b\" (UID: \"af46f421-3e8b-45b8-bea9-5a6d0468198b\") " Jul 09 17:43:58.469444 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469419 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:43:58.469493 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469340 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:43:58.469634 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469613 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config" (OuterVolumeSpecName: "console-config") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:43:58.469703 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.469609 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca" (OuterVolumeSpecName: "service-ca") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:43:58.471128 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.471105 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:43:58.471251 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.471149 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd" (OuterVolumeSpecName: "kube-api-access-ztcvd") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "kube-api-access-ztcvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:43:58.471251 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.471159 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af46f421-3e8b-45b8-bea9-5a6d0468198b" (UID: "af46f421-3e8b-45b8-bea9-5a6d0468198b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570393 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570423 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570433 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570441 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570449 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztcvd\" (UniqueName: \"kubernetes.io/projected/af46f421-3e8b-45b8-bea9-5a6d0468198b-kube-api-access-ztcvd\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570458 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af46f421-3e8b-45b8-bea9-5a6d0468198b-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:58.570477 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:58.570466 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af46f421-3e8b-45b8-bea9-5a6d0468198b-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:43:59.148852 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.148757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" event={"ID":"0d0dc752-59d2-4e3c-94ec-944210af8c54","Type":"ContainerStarted","Data":"70bdc6065393b2c8c7acd24f5c013cb2d81899a3c5e36023bfba76c6c189091c"} Jul 09 17:43:59.150153 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.150120 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" event={"ID":"7ee0501b-7116-4063-a65a-4b4d04b01c58","Type":"ContainerStarted","Data":"fce5ad0e0e30d769be382854f79dbfd6834f77f6c3a1900609fdde92d084f93e"} Jul 09 17:43:59.151892 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.151864 2557 generic.go:356] "Generic (PLEG): container finished" podID="af46f421-3e8b-45b8-bea9-5a6d0468198b" containerID="3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6" exitCode=0 Jul 09 17:43:59.151984 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.151919 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbb87865-kfpm2" event={"ID":"af46f421-3e8b-45b8-bea9-5a6d0468198b","Type":"ContainerDied","Data":"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6"} Jul 09 17:43:59.151984 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.151952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dbb87865-kfpm2" event={"ID":"af46f421-3e8b-45b8-bea9-5a6d0468198b","Type":"ContainerDied","Data":"d6927bda7946a1ae5140a2e09ef86c347ceb073ff1550d9b6c265f0aa2e7eaa5"} Jul 09 17:43:59.151984 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.151976 2557 scope.go:117] "RemoveContainer" containerID="3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6" Jul 09 17:43:59.152189 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.152137 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dbb87865-kfpm2" Jul 09 17:43:59.162620 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.162599 2557 scope.go:117] "RemoveContainer" containerID="3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6" Jul 09 17:43:59.163179 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:43:59.163125 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6\": container with ID starting with 3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6 not found: ID does not exist" containerID="3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6" Jul 09 17:43:59.163324 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.163239 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6"} err="failed to get container status \"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6\": rpc error: code = NotFound desc = could not find container \"3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6\": container with ID starting with 3856be5b11a861692e16aa1081fadf3577924b3b54937bc672f317c97cc5ccb6 not found: ID does not exist" Jul 09 17:43:59.172529 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.172504 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:43:59.175260 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:43:59.175237 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56dbb87865-kfpm2"] Jul 09 17:44:00.930685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:00.930651 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af46f421-3e8b-45b8-bea9-5a6d0468198b" path="/var/lib/kubelet/pods/af46f421-3e8b-45b8-bea9-5a6d0468198b/volumes" Jul 09 17:44:01.163548 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:01.163507 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" event={"ID":"0d0dc752-59d2-4e3c-94ec-944210af8c54","Type":"ContainerStarted","Data":"1c326dc6a76c674d53136a7754bec154426e06c06fe57fc6e0d7c93db4f686ad"} Jul 09 17:44:01.182402 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:01.182300 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b7446f56-z9bw2" podStartSLOduration=1.818616408 podStartE2EDuration="4.182282495s" totalImagesPullingTime="2.363666087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:44:01.181702424 +0000 UTC m=+274.927691355" watchObservedRunningTime="2026-07-09 17:44:01.182282495 +0000 UTC m=+274.928271425" Jul 09 17:44:04.178846 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:04.178808 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" event={"ID":"7ee0501b-7116-4063-a65a-4b4d04b01c58","Type":"ContainerStarted","Data":"4aacebd85824b115a6735d5f37746abba96df67d615d374d7d172d30fd01412d"} Jul 09 17:44:04.179249 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:04.179018 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:44:04.180858 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:04.180838 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" Jul 09 17:44:04.196324 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:04.196249 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8586597bf-vrjtm" podStartSLOduration=1.592481175 podStartE2EDuration="7.196236478s" totalImagesPullingTime="5.603755303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:44:04.195727891 +0000 UTC m=+277.941716821" watchObservedRunningTime="2026-07-09 17:44:04.196236478 +0000 UTC m=+277.942225407" Jul 09 17:44:26.706709 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:26.706675 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:44:26.709405 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:26.709378 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:44:26.710034 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:26.710013 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 17:44:55.113278 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:44:55.113240 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:06.780039 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:06.780001 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:06.877606 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:06.877563 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:07.202773 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:07.202735 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:07.307080 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:07.307044 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:07.458215 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:07.458095 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:09.042448 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.042404 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st"] Jul 09 17:45:09.042832 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.042723 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af46f421-3e8b-45b8-bea9-5a6d0468198b" containerName="console" Jul 09 17:45:09.042832 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.042734 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af46f421-3e8b-45b8-bea9-5a6d0468198b" containerName="console" Jul 09 17:45:09.042832 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.042782 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af46f421-3e8b-45b8-bea9-5a6d0468198b" containerName="console" Jul 09 17:45:09.044943 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.044926 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.047946 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.047922 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 17:45:09.048093 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.048011 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g96pn\"" Jul 09 17:45:09.049498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.049478 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 17:45:09.056027 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.056005 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st"] Jul 09 17:45:09.129386 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.129346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95f7b\" (UniqueName: \"kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.129578 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.129468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.129578 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.129496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.230274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.230237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95f7b\" (UniqueName: \"kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.230418 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.230329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.230418 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.230349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.230705 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.230682 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.230740 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.230726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.240075 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.240041 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95f7b\" (UniqueName: \"kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.354801 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.354718 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:09.489435 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.489401 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st"] Jul 09 17:45:09.493392 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:45:09.493364 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d731c5b_f2b0_4804_b0bd_fd8936349495.slice/crio-b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4 WatchSource:0}: Error finding container b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4: Status 404 returned error can't find the container with id b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4 Jul 09 17:45:09.495408 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:09.495390 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:45:10.426625 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:10.426590 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" event={"ID":"0d731c5b-f2b0-4804-b0bd-fd8936349495","Type":"ContainerStarted","Data":"b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4"} Jul 09 17:45:17.457948 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:17.457909 2557 generic.go:356] "Generic (PLEG): container finished" podID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerID="7f7d2014482d066931e072be7163e95b1b1ed9c8fd38ff7c22dd0a442d183d0f" exitCode=0 Jul 09 17:45:17.458334 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:17.457992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" event={"ID":"0d731c5b-f2b0-4804-b0bd-fd8936349495","Type":"ContainerDied","Data":"7f7d2014482d066931e072be7163e95b1b1ed9c8fd38ff7c22dd0a442d183d0f"} Jul 09 17:45:19.469035 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:19.468939 2557 generic.go:356] "Generic (PLEG): container finished" podID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerID="9250bf931bafe33aa19b638a1e58e9b27029a5a0035cc3a29875ac231d456db5" exitCode=0 Jul 09 17:45:19.469454 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:19.469025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" event={"ID":"0d731c5b-f2b0-4804-b0bd-fd8936349495","Type":"ContainerDied","Data":"9250bf931bafe33aa19b638a1e58e9b27029a5a0035cc3a29875ac231d456db5"} Jul 09 17:45:26.504045 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:26.503956 2557 generic.go:356] "Generic (PLEG): container finished" podID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerID="e5396e06ac8ccd971a83523a294526aefb91b949b00d77e35d3965b4aa25d5dc" exitCode=0 Jul 09 17:45:26.504418 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:26.504045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" event={"ID":"0d731c5b-f2b0-4804-b0bd-fd8936349495","Type":"ContainerDied","Data":"e5396e06ac8ccd971a83523a294526aefb91b949b00d77e35d3965b4aa25d5dc"} Jul 09 17:45:27.630230 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.630200 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:27.695476 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.695443 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util\") pod \"0d731c5b-f2b0-4804-b0bd-fd8936349495\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " Jul 09 17:45:27.695644 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.695503 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95f7b\" (UniqueName: \"kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b\") pod \"0d731c5b-f2b0-4804-b0bd-fd8936349495\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " Jul 09 17:45:27.695644 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.695546 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle\") pod \"0d731c5b-f2b0-4804-b0bd-fd8936349495\" (UID: \"0d731c5b-f2b0-4804-b0bd-fd8936349495\") " Jul 09 17:45:27.696246 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.696218 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle" (OuterVolumeSpecName: "bundle") pod "0d731c5b-f2b0-4804-b0bd-fd8936349495" (UID: "0d731c5b-f2b0-4804-b0bd-fd8936349495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:45:27.697724 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.697694 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b" (OuterVolumeSpecName: "kube-api-access-95f7b") pod "0d731c5b-f2b0-4804-b0bd-fd8936349495" (UID: "0d731c5b-f2b0-4804-b0bd-fd8936349495"). InnerVolumeSpecName "kube-api-access-95f7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:45:27.699671 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.699650 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util" (OuterVolumeSpecName: "util") pod "0d731c5b-f2b0-4804-b0bd-fd8936349495" (UID: "0d731c5b-f2b0-4804-b0bd-fd8936349495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:45:27.796947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.796873 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-util\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:45:27.796947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.796901 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95f7b\" (UniqueName: \"kubernetes.io/projected/0d731c5b-f2b0-4804-b0bd-fd8936349495-kube-api-access-95f7b\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:45:27.796947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:27.796912 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d731c5b-f2b0-4804-b0bd-fd8936349495-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:45:28.512665 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:28.512633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" event={"ID":"0d731c5b-f2b0-4804-b0bd-fd8936349495","Type":"ContainerDied","Data":"b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4"} Jul 09 17:45:28.512826 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:28.512706 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b32d9c2a635215cb16e937611ac1272357d3101b7826b16421016a69ef0d7cb4" Jul 09 17:45:28.512826 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:28.512647 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zg6st" Jul 09 17:45:31.052741 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:31.052710 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:31.296978 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:31.296944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:32.354826 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.354791 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm"] Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355096 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="pull" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355107 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="pull" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355123 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="util" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355129 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="util" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355144 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="extract" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355149 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="extract" Jul 09 17:45:32.355212 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.355213 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d731c5b-f2b0-4804-b0bd-fd8936349495" containerName="extract" Jul 09 17:45:32.387668 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.387635 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm"] Jul 09 17:45:32.387809 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.387754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.391032 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.391003 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 09 17:45:32.391189 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.391045 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 09 17:45:32.391360 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.391345 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2xg92\"" Jul 09 17:45:32.391410 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.391372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 09 17:45:32.539698 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.539663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3c4d302d-8575-4616-bd68-0dcecf982b63-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.539864 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.539722 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcc7\" (UniqueName: \"kubernetes.io/projected/3c4d302d-8575-4616-bd68-0dcecf982b63-kube-api-access-8gcc7\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.640933 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.640898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcc7\" (UniqueName: \"kubernetes.io/projected/3c4d302d-8575-4616-bd68-0dcecf982b63-kube-api-access-8gcc7\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.641087 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.640993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3c4d302d-8575-4616-bd68-0dcecf982b63-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.643231 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.643209 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3c4d302d-8575-4616-bd68-0dcecf982b63-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.651648 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.651627 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcc7\" (UniqueName: \"kubernetes.io/projected/3c4d302d-8575-4616-bd68-0dcecf982b63-kube-api-access-8gcc7\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm\" (UID: \"3c4d302d-8575-4616-bd68-0dcecf982b63\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.698597 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.698562 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:32.869313 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:32.869121 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm"] Jul 09 17:45:32.872451 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:45:32.872424 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4d302d_8575_4616_bd68_0dcecf982b63.slice/crio-2db707d34ede6069d13c4716932303059d4903a017c36802558b0cfc0ca43ca9 WatchSource:0}: Error finding container 2db707d34ede6069d13c4716932303059d4903a017c36802558b0cfc0ca43ca9: Status 404 returned error can't find the container with id 2db707d34ede6069d13c4716932303059d4903a017c36802558b0cfc0ca43ca9 Jul 09 17:45:33.534349 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:33.534297 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" event={"ID":"3c4d302d-8575-4616-bd68-0dcecf982b63","Type":"ContainerStarted","Data":"2db707d34ede6069d13c4716932303059d4903a017c36802558b0cfc0ca43ca9"} Jul 09 17:45:36.234522 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.234483 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:36.532119 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.532025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:36.532686 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.532665 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-jfcrs"] Jul 09 17:45:36.534921 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.534905 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.538087 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.538068 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 09 17:45:36.538328 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.538303 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8w9zk\"" Jul 09 17:45:36.538479 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.538415 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 09 17:45:36.549652 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.549620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" event={"ID":"3c4d302d-8575-4616-bd68-0dcecf982b63","Type":"ContainerStarted","Data":"c92313f11e28572bdf792d16f89c23305ef748e5d1a521e0d69cf31e6ba9f537"} Jul 09 17:45:36.549785 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.549773 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:45:36.551046 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.551023 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jfcrs"] Jul 09 17:45:36.587636 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.587579 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" podStartSLOduration=1.717153519 podStartE2EDuration="4.587562567s" totalImagesPullingTime="2.870409048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:36.58650789 +0000 UTC m=+370.332496821" watchObservedRunningTime="2026-07-09 17:45:36.587562567 +0000 UTC m=+370.333551497" Jul 09 17:45:36.675138 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.675100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.675327 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.675151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqd7\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-kube-api-access-hvqd7\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.675327 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.675287 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/465f372c-d695-4c42-a202-812df5706d01-cabundle0\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.727128 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.727095 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:36.728469 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.728442 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8l64"] Jul 09 17:45:36.730886 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.730868 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.733792 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.733774 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 09 17:45:36.742540 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.742512 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8l64"] Jul 09 17:45:36.775974 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.775946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.775981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqd7\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-kube-api-access-hvqd7\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.776028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/465f372c-d695-4c42-a202-812df5706d01-cabundle0\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.776100 2557 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.776122 2557 secret.go:281] references non-existent secret key: ca.crt Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.776130 2557 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 09 17:45:36.776150 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.776142 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-jfcrs: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 17:45:36.776475 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.776214 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates podName:465f372c-d695-4c42-a202-812df5706d01 nodeName:}" failed. No retries permitted until 2026-07-09 17:45:37.276195755 +0000 UTC m=+371.022184672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates") pod "keda-operator-68bff59c-jfcrs" (UID: "465f372c-d695-4c42-a202-812df5706d01") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 17:45:36.776696 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.776680 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/465f372c-d695-4c42-a202-812df5706d01-cabundle0\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.785821 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.785774 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqd7\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-kube-api-access-hvqd7\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:36.876501 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.876467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzhbq\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-kube-api-access-fzhbq\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.876501 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.876507 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.876757 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.876532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.977683 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.977652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzhbq\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-kube-api-access-fzhbq\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.977874 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.977700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.977874 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.977734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.977947 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.977890 2557 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 09 17:45:36.977947 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.977912 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-l8l64: secret "keda-metrics-apiserver-certs" not found Jul 09 17:45:36.978008 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:45:36.977969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates podName:3e908f42-6f1d-4941-b6f5-d6d8c5f5db30 nodeName:}" failed. No retries permitted until 2026-07-09 17:45:37.477951017 +0000 UTC m=+371.223939929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates") pod "keda-metrics-apiserver-559f75f947-l8l64" (UID: "3e908f42-6f1d-4941-b6f5-d6d8c5f5db30") : secret "keda-metrics-apiserver-certs" not found Jul 09 17:45:36.978125 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.978098 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:36.995931 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:36.995897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzhbq\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-kube-api-access-fzhbq\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:37.062394 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.062280 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.100284 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.100247 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-5wwzc"] Jul 09 17:45:37.102699 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.102680 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.107147 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.107120 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 09 17:45:37.117545 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.117518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-5wwzc"] Jul 09 17:45:37.172816 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.172758 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.280799 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.280753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5gfg\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-kube-api-access-j5gfg\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.281290 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.280827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-certificates\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.281290 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.280893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:37.282730 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.282694 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.283848 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.283826 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/465f372c-d695-4c42-a202-812df5706d01-certificates\") pod \"keda-operator-68bff59c-jfcrs\" (UID: \"465f372c-d695-4c42-a202-812df5706d01\") " pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:37.372150 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.372109 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.381514 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.381482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5gfg\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-kube-api-access-j5gfg\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.381676 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.381544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-certificates\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.385830 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.385804 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-certificates\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.392996 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.392962 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5gfg\" (UniqueName: \"kubernetes.io/projected/bb5cd081-e129-4e18-b527-2fb00f4295d2-kube-api-access-j5gfg\") pod \"keda-admission-5fbd5c4644-5wwzc\" (UID: \"bb5cd081-e129-4e18-b527-2fb00f4295d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.414960 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.414929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:37.445145 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.445097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:37.478727 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.478692 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.482291 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.482224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:37.489512 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.488299 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e908f42-6f1d-4941-b6f5-d6d8c5f5db30-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8l64\" (UID: \"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:37.595039 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.594988 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-5wwzc"] Jul 09 17:45:37.599357 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:45:37.599326 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5cd081_e129_4e18_b527_2fb00f4295d2.slice/crio-024feb81026125ff81674911766dd1ee67cee3c4bfd97612485460e48969dedd WatchSource:0}: Error finding container 024feb81026125ff81674911766dd1ee67cee3c4bfd97612485460e48969dedd: Status 404 returned error can't find the container with id 024feb81026125ff81674911766dd1ee67cee3c4bfd97612485460e48969dedd Jul 09 17:45:37.626602 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.626577 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jfcrs"] Jul 09 17:45:37.643621 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.643594 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:37.675380 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.675334 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:37.801755 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:37.801731 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8l64"] Jul 09 17:45:37.804295 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:45:37.804269 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e908f42_6f1d_4941_b6f5_d6d8c5f5db30.slice/crio-716fe54adf97badadc847d9b1edcff5ab3b43e9b3f7bcdac9ab5db769ec2a194 WatchSource:0}: Error finding container 716fe54adf97badadc847d9b1edcff5ab3b43e9b3f7bcdac9ab5db769ec2a194: Status 404 returned error can't find the container with id 716fe54adf97badadc847d9b1edcff5ab3b43e9b3f7bcdac9ab5db769ec2a194 Jul 09 17:45:38.516777 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:38.516741 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:38.563920 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:38.563875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" event={"ID":"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30","Type":"ContainerStarted","Data":"716fe54adf97badadc847d9b1edcff5ab3b43e9b3f7bcdac9ab5db769ec2a194"} Jul 09 17:45:38.565227 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:38.565200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jfcrs" event={"ID":"465f372c-d695-4c42-a202-812df5706d01","Type":"ContainerStarted","Data":"456d1f421a3c74b86f918807e7fb4405f31fc28d37f798ac5e7504722fd70644"} Jul 09 17:45:38.566694 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:38.566568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" event={"ID":"bb5cd081-e129-4e18-b527-2fb00f4295d2","Type":"ContainerStarted","Data":"024feb81026125ff81674911766dd1ee67cee3c4bfd97612485460e48969dedd"} Jul 09 17:45:38.620299 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:38.620254 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:45:39.575274 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:39.575226 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" event={"ID":"bb5cd081-e129-4e18-b527-2fb00f4295d2","Type":"ContainerStarted","Data":"2a716955d509cc7666bd0fedb000534c6b07b5d73719ebc62b75f0191829597e"} Jul 09 17:45:39.575708 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:39.575378 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:45:39.602414 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:39.602361 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" podStartSLOduration=1.269210174 podStartE2EDuration="2.602339656s" totalImagesPullingTime="1.333129482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:39.600374111 +0000 UTC m=+373.346363042" watchObservedRunningTime="2026-07-09 17:45:39.602339656 +0000 UTC m=+373.348328590" Jul 09 17:45:42.592038 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.592001 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" event={"ID":"3e908f42-6f1d-4941-b6f5-d6d8c5f5db30","Type":"ContainerStarted","Data":"cbfe765c9e48c1537c8031ae60777eb0b6eedaab0b15a17f98d9aacba321570d"} Jul 09 17:45:42.592503 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.592214 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:42.593525 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.593502 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jfcrs" event={"ID":"465f372c-d695-4c42-a202-812df5706d01","Type":"ContainerStarted","Data":"63a65e616f7d3f7acb9589a1820168c17efd86f0d40136d0a91785ff81abf8d2"} Jul 09 17:45:42.593638 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.593621 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:45:42.616922 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.616877 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" podStartSLOduration=2.719299732 podStartE2EDuration="6.616861747s" totalImagesPullingTime="3.897562015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:42.615838315 +0000 UTC m=+376.361827246" watchObservedRunningTime="2026-07-09 17:45:42.616861747 +0000 UTC m=+376.362850676" Jul 09 17:45:42.636660 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:42.636615 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-jfcrs" podStartSLOduration=2.563593565 podStartE2EDuration="6.636600641s" totalImagesPullingTime="4.073007076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:42.635718479 +0000 UTC m=+376.381707443" watchObservedRunningTime="2026-07-09 17:45:42.636600641 +0000 UTC m=+376.382589588" Jul 09 17:45:53.603829 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:53.603798 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8l64" Jul 09 17:45:57.560125 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:45:57.560093 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-xb5hm" Jul 09 17:46:00.584972 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:00.584939 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-5wwzc" Jul 09 17:46:03.600628 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:03.600597 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-jfcrs" Jul 09 17:46:29.350508 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:29.350469 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:29.455508 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:29.455466 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:48.795099 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.795000 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:48.880796 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.880764 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:46:48.883325 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.883308 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:48.888848 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.888828 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 17:46:48.888962 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.888918 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 17:46:48.889071 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.889051 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 17:46:48.890254 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.890234 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-vr7xv\"" Jul 09 17:46:48.906976 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.906944 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:46:48.907897 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.907869 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:48.963850 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.963816 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnh5\" (UniqueName: \"kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:48.964016 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:48.963859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.014042 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.014003 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:49.064867 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.064793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnh5\" (UniqueName: \"kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.064867 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.064835 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.067237 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.067206 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.074715 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.074687 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnh5\" (UniqueName: \"kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5\") pod \"kserve-controller-manager-6b8548bc6d-kj8rq\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.115745 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.115713 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:49.193600 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.193563 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:49.324057 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.324030 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:46:49.326841 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:46:49.326807 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f8cf7f_e15a_4e21_a1bb_7c49ca44e2c0.slice/crio-2f49ce7dbd448bbd0bf7a33f4340327e1685b9b8eb2e5a7d76e22a06d7666704 WatchSource:0}: Error finding container 2f49ce7dbd448bbd0bf7a33f4340327e1685b9b8eb2e5a7d76e22a06d7666704: Status 404 returned error can't find the container with id 2f49ce7dbd448bbd0bf7a33f4340327e1685b9b8eb2e5a7d76e22a06d7666704 Jul 09 17:46:49.576669 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.576575 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:49.891463 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.891420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" event={"ID":"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0","Type":"ContainerStarted","Data":"2f49ce7dbd448bbd0bf7a33f4340327e1685b9b8eb2e5a7d76e22a06d7666704"} Jul 09 17:46:49.996464 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:49.996415 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:50.097609 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:50.097542 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:50.171893 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:50.171768 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:46:51.902872 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:51.902776 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" event={"ID":"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0","Type":"ContainerStarted","Data":"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa"} Jul 09 17:46:51.903263 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:51.902890 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:46:51.922458 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:46:51.922386 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" podStartSLOduration=1.62139609 podStartE2EDuration="3.922368279s" totalImagesPullingTime="2.300972189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:46:51.921405804 +0000 UTC m=+445.667394735" watchObservedRunningTime="2026-07-09 17:46:51.922368279 +0000 UTC m=+445.668357209" Jul 09 17:47:16.936482 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:16.936445 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d96f48b9-xrdjk"] Jul 09 17:47:16.941152 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:16.941126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:16.950504 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:16.950476 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d96f48b9-xrdjk"] Jul 09 17:47:16.992335 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:16.992283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:17.006337 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-oauth-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006445 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-oauth-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006445 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006445 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-trusted-ca-bundle\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006611 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006587 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006661 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-service-ca\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.006704 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.006659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgbnx\" (UniqueName: \"kubernetes.io/projected/655972fc-0e4c-4cb9-9963-ee8150160d8d-kube-api-access-vgbnx\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.101433 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.101400 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:17.107856 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.107828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-oauth-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.107975 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.107872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.107975 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.107899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-trusted-ca-bundle\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.107975 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.107950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.107975 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.107970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-service-ca\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.108211 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgbnx\" (UniqueName: \"kubernetes.io/projected/655972fc-0e4c-4cb9-9963-ee8150160d8d-kube-api-access-vgbnx\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.108211 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-oauth-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.108747 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108721 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-service-ca\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.108849 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108797 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-oauth-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.108910 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108863 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.109011 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.108988 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655972fc-0e4c-4cb9-9963-ee8150160d8d-trusted-ca-bundle\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.110374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.110353 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-oauth-config\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.110480 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.110464 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/655972fc-0e4c-4cb9-9963-ee8150160d8d-console-serving-cert\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.123501 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.123471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgbnx\" (UniqueName: \"kubernetes.io/projected/655972fc-0e4c-4cb9-9963-ee8150160d8d-kube-api-access-vgbnx\") pod \"console-55d96f48b9-xrdjk\" (UID: \"655972fc-0e4c-4cb9-9963-ee8150160d8d\") " pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.198280 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.198193 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:17.250307 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.250272 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:17.385227 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.385198 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d96f48b9-xrdjk"] Jul 09 17:47:17.387008 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:47:17.386980 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655972fc_0e4c_4cb9_9963_ee8150160d8d.slice/crio-ad0b5febab4726351954b407bea2795804883939d466acbb9a6c9de9d97e5718 WatchSource:0}: Error finding container ad0b5febab4726351954b407bea2795804883939d466acbb9a6c9de9d97e5718: Status 404 returned error can't find the container with id ad0b5febab4726351954b407bea2795804883939d466acbb9a6c9de9d97e5718 Jul 09 17:47:17.738801 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.738768 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:17.810051 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:17.810005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:18.019739 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:18.019631 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d96f48b9-xrdjk" event={"ID":"655972fc-0e4c-4cb9-9963-ee8150160d8d","Type":"ContainerStarted","Data":"f5e223836514aa665c03f080d98804620b8613a91289ef0b29b7d5976cb68378"} Jul 09 17:47:18.019739 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:18.019677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d96f48b9-xrdjk" event={"ID":"655972fc-0e4c-4cb9-9963-ee8150160d8d","Type":"ContainerStarted","Data":"ad0b5febab4726351954b407bea2795804883939d466acbb9a6c9de9d97e5718"} Jul 09 17:47:18.043898 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:18.043847 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d96f48b9-xrdjk" podStartSLOduration=2.043831245 podStartE2EDuration="2.043831245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:47:18.042332595 +0000 UTC m=+471.788321539" watchObservedRunningTime="2026-07-09 17:47:18.043831245 +0000 UTC m=+471.789820175" Jul 09 17:47:22.912510 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:22.912476 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:47:26.441425 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.441390 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:47:26.441874 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.441607 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" podUID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" containerName="manager" containerID="cri-o://b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa" gracePeriod=10 Jul 09 17:47:26.471801 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.471771 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-6vgbn"] Jul 09 17:47:26.474921 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.474903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.488334 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.488306 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-6vgbn"] Jul 09 17:47:26.589396 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.589359 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1975b0b1-2d74-4279-887b-763723a3e758-cert\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.589579 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.589404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkkkc\" (UniqueName: \"kubernetes.io/projected/1975b0b1-2d74-4279-887b-763723a3e758-kube-api-access-qkkkc\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.689753 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.689730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1975b0b1-2d74-4279-887b-763723a3e758-cert\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.689877 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.689766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkkkc\" (UniqueName: \"kubernetes.io/projected/1975b0b1-2d74-4279-887b-763723a3e758-kube-api-access-qkkkc\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.691935 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.691887 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:47:26.692015 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.691998 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1975b0b1-2d74-4279-887b-763723a3e758-cert\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.707377 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.707345 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkkkc\" (UniqueName: \"kubernetes.io/projected/1975b0b1-2d74-4279-887b-763723a3e758-kube-api-access-qkkkc\") pod \"kserve-controller-manager-6b8548bc6d-6vgbn\" (UID: \"1975b0b1-2d74-4279-887b-763723a3e758\") " pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.790456 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.790424 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdnh5\" (UniqueName: \"kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5\") pod \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " Jul 09 17:47:26.790606 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.790492 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert\") pod \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\" (UID: \"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0\") " Jul 09 17:47:26.792600 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.792570 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert" (OuterVolumeSpecName: "cert") pod "51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" (UID: "51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:47:26.792708 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.792607 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5" (OuterVolumeSpecName: "kube-api-access-gdnh5") pod "51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" (UID: "51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0"). InnerVolumeSpecName "kube-api-access-gdnh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:47:26.824517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.824494 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:26.891030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.891003 2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:26.891030 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.891028 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdnh5\" (UniqueName: \"kubernetes.io/projected/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0-kube-api-access-gdnh5\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:26.966600 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:26.966578 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-6vgbn"] Jul 09 17:47:26.968546 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:47:26.968518 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1975b0b1_2d74_4279_887b_763723a3e758.slice/crio-5ed0839966e05482fcbd54a91db211dc35e8bb9a069b704b678d41ccf701c400 WatchSource:0}: Error finding container 5ed0839966e05482fcbd54a91db211dc35e8bb9a069b704b678d41ccf701c400: Status 404 returned error can't find the container with id 5ed0839966e05482fcbd54a91db211dc35e8bb9a069b704b678d41ccf701c400 Jul 09 17:47:27.058561 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.058527 2557 generic.go:356] "Generic (PLEG): container finished" podID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" containerID="b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa" exitCode=0 Jul 09 17:47:27.058754 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.058585 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" Jul 09 17:47:27.058754 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.058626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" event={"ID":"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0","Type":"ContainerDied","Data":"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa"} Jul 09 17:47:27.058754 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.058685 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-kj8rq" event={"ID":"51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0","Type":"ContainerDied","Data":"2f49ce7dbd448bbd0bf7a33f4340327e1685b9b8eb2e5a7d76e22a06d7666704"} Jul 09 17:47:27.058754 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.058714 2557 scope.go:117] "RemoveContainer" containerID="b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa" Jul 09 17:47:27.059802 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.059775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" event={"ID":"1975b0b1-2d74-4279-887b-763723a3e758","Type":"ContainerStarted","Data":"5ed0839966e05482fcbd54a91db211dc35e8bb9a069b704b678d41ccf701c400"} Jul 09 17:47:27.066658 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.066636 2557 scope.go:117] "RemoveContainer" containerID="b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa" Jul 09 17:47:27.066947 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:47:27.066926 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa\": container with ID starting with b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa not found: ID does not exist" containerID="b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa" Jul 09 17:47:27.067026 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.066955 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa"} err="failed to get container status \"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa\": rpc error: code = NotFound desc = could not find container \"b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa\": container with ID starting with b02d5d3518e1081e50e4b5781596e538a5d9bda54c155ddc7424e3e5a0ab1aaa not found: ID does not exist" Jul 09 17:47:27.076644 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.076616 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:47:27.080521 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.080497 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-kj8rq"] Jul 09 17:47:27.250814 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.250723 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:27.250814 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.250789 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:27.255343 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:27.255322 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:28.066678 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.066642 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" event={"ID":"1975b0b1-2d74-4279-887b-763723a3e758","Type":"ContainerStarted","Data":"2cb8c387b4f3c6db9be1dd5420ee76046c6b803e796e935a35046c416aa4155c"} Jul 09 17:47:28.067127 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.066701 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:47:28.071478 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.071453 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d96f48b9-xrdjk" Jul 09 17:47:28.087803 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.087759 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" podStartSLOduration=1.5466766939999999 podStartE2EDuration="2.087744883s" totalImagesPullingTime="541.068189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:47:28.087064801 +0000 UTC m=+481.833053732" watchObservedRunningTime="2026-07-09 17:47:28.087744883 +0000 UTC m=+481.833733813" Jul 09 17:47:28.159436 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.159405 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:47:28.282908 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.282871 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:28.384342 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.384310 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:28.485123 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.485083 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:47:28.930897 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:28.930864 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" path="/var/lib/kubelet/pods/51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0/volumes" Jul 09 17:47:53.179653 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.179592 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7959c6469f-xphxr" podUID="0950abea-9dbd-4f73-b833-810197aa1581" containerName="console" containerID="cri-o://639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5" gracePeriod=15 Jul 09 17:47:53.418460 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.418437 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:47:53.519258 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519158 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519258 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519212 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519258 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519239 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519296 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519326 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519352 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s76pn\" (UniqueName: \"kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519498 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519406 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config\") pod \"0950abea-9dbd-4f73-b833-810197aa1581\" (UID: \"0950abea-9dbd-4f73-b833-810197aa1581\") " Jul 09 17:47:53.519712 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519681 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca" (OuterVolumeSpecName: "service-ca") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:47:53.519774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519690 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config" (OuterVolumeSpecName: "console-config") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:47:53.519774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519720 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:47:53.519774 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.519733 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:47:53.521337 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.521313 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:47:53.521456 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.521416 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:47:53.521513 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.521467 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn" (OuterVolumeSpecName: "kube-api-access-s76pn") pod "0950abea-9dbd-4f73-b833-810197aa1581" (UID: "0950abea-9dbd-4f73-b833-810197aa1581"). InnerVolumeSpecName "kube-api-access-s76pn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:47:53.620342 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620308 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-trusted-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620342 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620339 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-oauth-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620342 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620351 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s76pn\" (UniqueName: \"kubernetes.io/projected/0950abea-9dbd-4f73-b833-810197aa1581-kube-api-access-s76pn\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620593 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620363 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-oauth-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620593 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620377 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0950abea-9dbd-4f73-b833-810197aa1581-console-serving-cert\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620593 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620390 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-service-ca\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:53.620593 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:53.620402 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0950abea-9dbd-4f73-b833-810197aa1581-console-config\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:47:54.191057 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.191023 2557 generic.go:356] "Generic (PLEG): container finished" podID="0950abea-9dbd-4f73-b833-810197aa1581" containerID="639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5" exitCode=0 Jul 09 17:47:54.191428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.191066 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7959c6469f-xphxr" Jul 09 17:47:54.191428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.191107 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7959c6469f-xphxr" event={"ID":"0950abea-9dbd-4f73-b833-810197aa1581","Type":"ContainerDied","Data":"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5"} Jul 09 17:47:54.191428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.191160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7959c6469f-xphxr" event={"ID":"0950abea-9dbd-4f73-b833-810197aa1581","Type":"ContainerDied","Data":"d3071a4bf3a07c9316565d9882a91a9daf5d924c9c6a068a2399553455a85b33"} Jul 09 17:47:54.191428 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.191196 2557 scope.go:117] "RemoveContainer" containerID="639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5" Jul 09 17:47:54.199779 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.199761 2557 scope.go:117] "RemoveContainer" containerID="639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5" Jul 09 17:47:54.200033 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:47:54.200013 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5\": container with ID starting with 639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5 not found: ID does not exist" containerID="639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5" Jul 09 17:47:54.200078 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.200041 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5"} err="failed to get container status \"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5\": rpc error: code = NotFound desc = could not find container \"639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5\": container with ID starting with 639f8668f8ab4cfe6a01947d092727eb616edda14299c63f48e0ee722eb857a5 not found: ID does not exist" Jul 09 17:47:54.218551 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.218526 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:47:54.223048 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.223027 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7959c6469f-xphxr"] Jul 09 17:47:54.931411 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:54.931379 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0950abea-9dbd-4f73-b833-810197aa1581" path="/var/lib/kubelet/pods/0950abea-9dbd-4f73-b833-810197aa1581/volumes" Jul 09 17:47:59.077662 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:47:59.077628 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b8548bc6d-6vgbn" Jul 09 17:48:00.136131 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.136091 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:48:00.219531 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.219494 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zwdsx"] Jul 09 17:48:00.219947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.219931 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0950abea-9dbd-4f73-b833-810197aa1581" containerName="console" Jul 09 17:48:00.219994 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.219950 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0950abea-9dbd-4f73-b833-810197aa1581" containerName="console" Jul 09 17:48:00.219994 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.219966 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" containerName="manager" Jul 09 17:48:00.219994 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.219972 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" containerName="manager" Jul 09 17:48:00.220085 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.220026 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f8cf7f-e15a-4e21-a1bb-7c49ca44e2c0" containerName="manager" Jul 09 17:48:00.220085 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.220036 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0950abea-9dbd-4f73-b833-810197aa1581" containerName="console" Jul 09 17:48:00.224592 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.224570 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.228869 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.228848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 09 17:48:00.229060 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.229043 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-qslnl\"" Jul 09 17:48:00.234996 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.234974 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zwdsx"] Jul 09 17:48:00.275905 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.275865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-cert\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.276089 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.275979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lddr\" (UniqueName: \"kubernetes.io/projected/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-kube-api-access-8lddr\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.324089 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.324050 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:48:00.376461 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.376426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lddr\" (UniqueName: \"kubernetes.io/projected/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-kube-api-access-8lddr\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.376618 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.376475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-cert\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.378883 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.378861 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-cert\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.385433 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.385410 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lddr\" (UniqueName: \"kubernetes.io/projected/8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188-kube-api-access-8lddr\") pod \"odh-model-controller-84b54b7f97-zwdsx\" (UID: \"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188\") " pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.425115 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.424997 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:48:00.535666 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.535619 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:00.690460 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:00.690426 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zwdsx"] Jul 09 17:48:00.693060 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:48:00.693036 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf8ff7d_e49a_46f0_864b_f5ddcf9dc188.slice/crio-5383d793d7d5f723d1e6274ace791c458ddfd76ae07f73f9f29ccae207da25a0 WatchSource:0}: Error finding container 5383d793d7d5f723d1e6274ace791c458ddfd76ae07f73f9f29ccae207da25a0: Status 404 returned error can't find the container with id 5383d793d7d5f723d1e6274ace791c458ddfd76ae07f73f9f29ccae207da25a0 Jul 09 17:48:01.129015 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:01.128977 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:48:01.223348 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:01.223317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" event={"ID":"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188","Type":"ContainerStarted","Data":"5383d793d7d5f723d1e6274ace791c458ddfd76ae07f73f9f29ccae207da25a0"} Jul 09 17:48:01.231693 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:01.231642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:48:04.240140 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:04.240105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" event={"ID":"8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188","Type":"ContainerStarted","Data":"cc2623fb0b43d0d5df0b4b01babedbad689c274381ed3b748b4030b803ef0936"} Jul 09 17:48:04.240555 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:04.240328 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:04.262649 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:04.262585 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" podStartSLOduration=0.892960331 podStartE2EDuration="4.262568465s" totalImagesPullingTime="3.369608134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:48:04.261878266 +0000 UTC m=+518.007867197" watchObservedRunningTime="2026-07-09 17:48:04.262568465 +0000 UTC m=+518.008557395" Jul 09 17:48:15.248369 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:15.248338 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-zwdsx" Jul 09 17:48:41.360271 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:48:41.360231 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:49:15.035694 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:15.035659 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:49:26.736943 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:26.736917 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:49:26.737643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:26.737622 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:49:35.420982 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:35.420943 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:49:35.521652 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:35.521614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:49:47.038693 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:47.038652 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:49:47.240338 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:49:47.240300 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:50:35.337621 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:50:35.337589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:51.326684 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:51.326621 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:52.253738 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:52.253683 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:52.353696 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:52.353649 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:52.454799 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:52.454756 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:52.544565 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:52.544478 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:51:52.764368 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:51:52.764335 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:52:40.527517 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:52:40.527476 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:32.421713 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.421670 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:32.422808 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.422784 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:53:32.426222 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.426201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:32.429421 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.429399 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-02e34-serving-cert\"" Jul 09 17:53:32.429421 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.429415 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 09 17:53:32.429771 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.429754 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-02e34-kube-rbac-proxy-sar-config\"" Jul 09 17:53:32.430929 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.430914 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cfv7h\"" Jul 09 17:53:32.435202 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.435161 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:53:32.494160 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.494124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:32.494368 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.494266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:32.595153 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.595114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:32.595347 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.595205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:32.595347 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:53:32.595309 2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-02e34-serving-cert: secret "model-chainer-raw-02e34-serving-cert" not found Jul 09 17:53:32.595467 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:53:32.595404 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls podName:a6551cde-8a10-43ca-8c12-cdb8730a9ad6 nodeName:}" failed. No retries permitted until 2026-07-09 17:53:33.095381788 +0000 UTC m=+846.841370728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls") pod "model-chainer-raw-02e34-699f4f88fd-9twms" (UID: "a6551cde-8a10-43ca-8c12-cdb8730a9ad6") : secret "model-chainer-raw-02e34-serving-cert" not found Jul 09 17:53:32.595794 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:32.595762 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:33.081420 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.081388 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:33.101188 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.101129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:33.103554 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.103527 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") pod \"model-chainer-raw-02e34-699f4f88fd-9twms\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:33.336680 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.336587 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:33.470231 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.470205 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:53:33.472504 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:53:33.472472 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6551cde_8a10_43ca_8c12_cdb8730a9ad6.slice/crio-ce4b2f45b71eee4c57ea3f9c2255c1928b3d1dc77066d3d1ff6dc46356dae998 WatchSource:0}: Error finding container ce4b2f45b71eee4c57ea3f9c2255c1928b3d1dc77066d3d1ff6dc46356dae998: Status 404 returned error can't find the container with id ce4b2f45b71eee4c57ea3f9c2255c1928b3d1dc77066d3d1ff6dc46356dae998 Jul 09 17:53:33.474397 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.474376 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:53:33.721046 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:33.721011 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" event={"ID":"a6551cde-8a10-43ca-8c12-cdb8730a9ad6","Type":"ContainerStarted","Data":"ce4b2f45b71eee4c57ea3f9c2255c1928b3d1dc77066d3d1ff6dc46356dae998"} Jul 09 17:53:36.737319 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:36.737284 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" event={"ID":"a6551cde-8a10-43ca-8c12-cdb8730a9ad6","Type":"ContainerStarted","Data":"6fbcbb3beb1aec995efa3c349df8ea2b47672ed9c2e2bdcade970c721c279c28"} Jul 09 17:53:36.737711 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:36.737413 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:53:36.760531 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:36.760478 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podStartSLOduration=2.456687365 podStartE2EDuration="4.760460146s" totalImagesPullingTime="2.303772781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:53:36.760077982 +0000 UTC m=+850.506066915" watchObservedRunningTime="2026-07-09 17:53:36.760460146 +0000 UTC m=+850.506449099" Jul 09 17:53:42.473573 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.473535 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:53:42.474147 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.473778 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" containerID="cri-o://6fbcbb3beb1aec995efa3c349df8ea2b47672ed9c2e2bdcade970c721c279c28" gracePeriod=30 Jul 09 17:53:42.480001 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.479965 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:53:42.501794 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.501754 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:42.673248 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.673209 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:42.764037 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.763948 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:42.842352 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.842317 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:42.943465 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:42.943428 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:43.173920 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:43.173880 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:53:47.477607 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:47.477563 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:53:52.478135 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:52.478094 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:53:57.477897 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:53:57.477856 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:54:02.478519 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:02.478476 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:54:07.477658 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:07.477615 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:54:12.478126 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:12.478075 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" probeResult="failure" output="Get \"https://10.134.0.32:8080/readyz\": dial tcp 10.134.0.32:8080: connect: connection refused" Jul 09 17:54:12.904146 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:12.904104 2557 generic.go:356] "Generic (PLEG): container finished" podID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerID="6fbcbb3beb1aec995efa3c349df8ea2b47672ed9c2e2bdcade970c721c279c28" exitCode=0 Jul 09 17:54:12.904348 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:12.904203 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" event={"ID":"a6551cde-8a10-43ca-8c12-cdb8730a9ad6","Type":"ContainerDied","Data":"6fbcbb3beb1aec995efa3c349df8ea2b47672ed9c2e2bdcade970c721c279c28"} Jul 09 17:54:13.137611 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.137582 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:54:13.235586 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.235495 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") pod \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " Jul 09 17:54:13.235586 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.235540 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle\") pod \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\" (UID: \"a6551cde-8a10-43ca-8c12-cdb8730a9ad6\") " Jul 09 17:54:13.235947 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.235919 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a6551cde-8a10-43ca-8c12-cdb8730a9ad6" (UID: "a6551cde-8a10-43ca-8c12-cdb8730a9ad6"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:54:13.237812 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.237788 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a6551cde-8a10-43ca-8c12-cdb8730a9ad6" (UID: "a6551cde-8a10-43ca-8c12-cdb8730a9ad6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:54:13.336643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.336610 2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-proxy-tls\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:54:13.336643 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.336640 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6551cde-8a10-43ca-8c12-cdb8730a9ad6-openshift-service-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:54:13.910322 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.910297 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" Jul 09 17:54:13.910784 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.910299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms" event={"ID":"a6551cde-8a10-43ca-8c12-cdb8730a9ad6","Type":"ContainerDied","Data":"ce4b2f45b71eee4c57ea3f9c2255c1928b3d1dc77066d3d1ff6dc46356dae998"} Jul 09 17:54:13.910784 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.910495 2557 scope.go:117] "RemoveContainer" containerID="6fbcbb3beb1aec995efa3c349df8ea2b47672ed9c2e2bdcade970c721c279c28" Jul 09 17:54:13.933306 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.933275 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:54:13.936818 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:13.936791 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-02e34-699f4f88fd-9twms"] Jul 09 17:54:14.931613 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:14.931577 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" path="/var/lib/kubelet/pods/a6551cde-8a10-43ca-8c12-cdb8730a9ad6/volumes" Jul 09 17:54:26.775138 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:26.775106 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:54:26.775138 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:54:26.775126 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:55:12.753345 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.753314 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:12.755765 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.753654 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" Jul 09 17:55:12.755765 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.753664 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" Jul 09 17:55:12.755765 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.753733 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6551cde-8a10-43ca-8c12-cdb8730a9ad6" containerName="model-chainer-raw-02e34" Jul 09 17:55:12.756619 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.756603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:12.759555 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.759529 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-079fb-serving-cert\"" Jul 09 17:55:12.759685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.759572 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-079fb-kube-rbac-proxy-sar-config\"" Jul 09 17:55:12.759685 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.759573 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 09 17:55:12.760987 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.760970 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cfv7h\"" Jul 09 17:55:12.765289 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.765262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:12.782461 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.782430 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:12.840860 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.840821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:12.841021 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.840897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:12.941272 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.941245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:12.941441 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.941308 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:12.941441 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:55:12.941396 2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-serving-cert: secret "model-chainer-raw-hpa-079fb-serving-cert" not found Jul 09 17:55:12.941518 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:55:12.941465 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls podName:3398e206-8c7a-41d8-9d11-e4964124dbe4 nodeName:}" failed. No retries permitted until 2026-07-09 17:55:13.44144857 +0000 UTC m=+947.187437478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls") pod "model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" (UID: "3398e206-8c7a-41d8-9d11-e4964124dbe4") : secret "model-chainer-raw-hpa-079fb-serving-cert" not found Jul 09 17:55:12.941844 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:12.941826 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:13.446306 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:13.446276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:13.446482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:55:13.446386 2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-serving-cert: secret "model-chainer-raw-hpa-079fb-serving-cert" not found Jul 09 17:55:13.446482 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:55:13.446446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls podName:3398e206-8c7a-41d8-9d11-e4964124dbe4 nodeName:}" failed. No retries permitted until 2026-07-09 17:55:14.446431966 +0000 UTC m=+948.192420874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls") pod "model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" (UID: "3398e206-8c7a-41d8-9d11-e4964124dbe4") : secret "model-chainer-raw-hpa-079fb-serving-cert" not found Jul 09 17:55:13.724687 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:13.724594 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:14.455452 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:14.455413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:14.457753 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:14.457732 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:14.567090 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:14.567049 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:14.695449 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:14.695425 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:14.697378 ip-10-0-135-252 kubenswrapper[2557]: W0709 17:55:14.697345 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3398e206_8c7a_41d8_9d11_e4964124dbe4.slice/crio-c199ed389a46baf048e5725d93a65dd35a2924d056deb8c8469cda748a405d55 WatchSource:0}: Error finding container c199ed389a46baf048e5725d93a65dd35a2924d056deb8c8469cda748a405d55: Status 404 returned error can't find the container with id c199ed389a46baf048e5725d93a65dd35a2924d056deb8c8469cda748a405d55 Jul 09 17:55:15.185200 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:15.185147 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" event={"ID":"3398e206-8c7a-41d8-9d11-e4964124dbe4","Type":"ContainerStarted","Data":"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e"} Jul 09 17:55:15.185374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:15.185220 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" event={"ID":"3398e206-8c7a-41d8-9d11-e4964124dbe4","Type":"ContainerStarted","Data":"c199ed389a46baf048e5725d93a65dd35a2924d056deb8c8469cda748a405d55"} Jul 09 17:55:15.185374 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:15.185242 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:15.206338 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:15.206286 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podStartSLOduration=3.206271281 podStartE2EDuration="3.206271281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:55:15.203241152 +0000 UTC m=+948.949230083" watchObservedRunningTime="2026-07-09 17:55:15.206271281 +0000 UTC m=+948.952260210" Jul 09 17:55:21.195273 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:21.195244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:22.878823 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:22.878788 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:22.879204 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:22.878959 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" containerID="cri-o://2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e" gracePeriod=30 Jul 09 17:55:22.961072 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:22.961030 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:23.051488 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:23.051440 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:23.142260 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:23.142119 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:23.231673 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:23.231640 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:26.194852 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:26.194814 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:31.194550 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:31.194509 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:36.194646 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:36.194604 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:36.195115 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:36.194732 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:41.194280 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:41.194234 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:43.079426 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:43.079383 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:44.268896 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:44.268863 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:55:46.194150 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:46.194114 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:51.193927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:51.193838 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:55:53.027712 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.027685 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:53.189391 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.189305 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle\") pod \"3398e206-8c7a-41d8-9d11-e4964124dbe4\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " Jul 09 17:55:53.189391 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.189380 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") pod \"3398e206-8c7a-41d8-9d11-e4964124dbe4\" (UID: \"3398e206-8c7a-41d8-9d11-e4964124dbe4\") " Jul 09 17:55:53.189664 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.189638 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3398e206-8c7a-41d8-9d11-e4964124dbe4" (UID: "3398e206-8c7a-41d8-9d11-e4964124dbe4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:55:53.191376 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.191347 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3398e206-8c7a-41d8-9d11-e4964124dbe4" (UID: "3398e206-8c7a-41d8-9d11-e4964124dbe4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:55:53.290513 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.290469 2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3398e206-8c7a-41d8-9d11-e4964124dbe4-proxy-tls\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:55:53.290513 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.290506 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3398e206-8c7a-41d8-9d11-e4964124dbe4-openshift-service-ca-bundle\") on node \"ip-10-0-135-252.ec2.internal\" DevicePath \"\"" Jul 09 17:55:53.357789 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.357759 2557 generic.go:356] "Generic (PLEG): container finished" podID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerID="2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e" exitCode=0 Jul 09 17:55:53.357927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.357800 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" Jul 09 17:55:53.357927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.357847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" event={"ID":"3398e206-8c7a-41d8-9d11-e4964124dbe4","Type":"ContainerDied","Data":"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e"} Jul 09 17:55:53.357927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.357899 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5" event={"ID":"3398e206-8c7a-41d8-9d11-e4964124dbe4","Type":"ContainerDied","Data":"c199ed389a46baf048e5725d93a65dd35a2924d056deb8c8469cda748a405d55"} Jul 09 17:55:53.357927 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.357925 2557 scope.go:117] "RemoveContainer" containerID="2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e" Jul 09 17:55:53.366523 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.366508 2557 scope.go:117] "RemoveContainer" containerID="2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e" Jul 09 17:55:53.366780 ip-10-0-135-252 kubenswrapper[2557]: E0709 17:55:53.366764 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e\": container with ID starting with 2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e not found: ID does not exist" containerID="2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e" Jul 09 17:55:53.366823 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.366787 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e"} err="failed to get container status \"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e\": rpc error: code = NotFound desc = could not find container \"2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e\": container with ID starting with 2632a7a0f299e531e49e63c612678286d255c4dadf27194a0672928219fb077e not found: ID does not exist" Jul 09 17:55:53.379483 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.379455 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:53.383600 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:53.383578 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-079fb-7cb556b7bb-dshl5"] Jul 09 17:55:54.931545 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:55:54.931510 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" path="/var/lib/kubelet/pods/3398e206-8c7a-41d8-9d11-e4964124dbe4/volumes" Jul 09 17:57:18.406990 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:57:18.406914 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:57:18.498417 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:57:18.498382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:57:18.601131 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:57:18.601096 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:57:18.747015 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:57:18.746937 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:58:12.284838 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:58:12.284805 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:59:26.804494 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:59:26.804466 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:59:26.805785 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:59:26.805767 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 17:59:43.627627 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:59:43.627590 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:59:43.688379 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:59:43.688344 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 17:59:58.612427 ip-10-0-135-252 kubenswrapper[2557]: I0709 17:59:58.612392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:00:03.720295 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:00:03.720254 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:00:04.174250 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:00:04.174207 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:00:07.679735 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:00:07.679691 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:00:07.746610 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:00:07.746575 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:00:21.459049 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:00:21.459014 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:34.118574 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:34.118533 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:35.917206 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:35.917161 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:52.020374 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:52.020292 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:52.089240 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:52.089189 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:57.239063 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:57.239012 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:01:57.684582 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:01:57.684537 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:02:07.300740 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:02:07.300694 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:02:12.455968 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:02:12.455911 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:02:12.721837 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:02:12.721753 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:03:28.154353 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:03:28.154314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:03:42.667309 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:03:42.667271 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:03:47.847553 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:03:47.847515 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:03:48.332732 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:03:48.332694 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:26.833258 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:04:26.833230 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 18:04:26.836189 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:04:26.836151 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 18:04:58.142574 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:04:58.142481 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:09.023990 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:09.023957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:17.952353 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:17.952311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:24.210218 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:24.210159 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:24.310091 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:24.310057 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:54.547965 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:54.547926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:54.718925 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:54.718892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:54.778216 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:54.778151 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:57.426237 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:57.426204 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jphq7_10ab9a00-7c69-4d92-a688-968b3ad604e7/global-pull-secret-syncer/0.log" Jul 09 18:05:57.543043 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:57.543013 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" Jul 09 18:05:57.642796 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:05:57.642747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-252.ec2.internal_bbcfbc2fdebeb48346da1bb838f11040/haproxy/0.log" Jul 09 18:06:00.468661 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:00.468630 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:00.537964 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:00.537928 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rvlp_68f3754d-1785-4f1f-80a1-7a1413c91e48/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:01.727014 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.726987 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/alertmanager/0.log" Jul 09 18:06:01.758791 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.758757 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/config-reloader/0.log" Jul 09 18:06:01.786224 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.786161 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/kube-rbac-proxy-web/0.log" Jul 09 18:06:01.809410 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.809381 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/kube-rbac-proxy/0.log" Jul 09 18:06:01.832442 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.832412 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/kube-rbac-proxy-metric/0.log" Jul 09 18:06:01.855258 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.855233 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/prom-label-proxy/0.log" Jul 09 18:06:01.880869 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:01.880843 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21cc27fa-9db1-4500-b057-8a513120ccf3/init-config-reloader/0.log" Jul 09 18:06:02.030561 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.030478 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84b58f995c-z4k8t_63f942a8-44d9-4fe6-8453-5aef44a9d2b2/metrics-server/0.log" Jul 09 18:06:02.258875 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.258846 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z97kp_4a677ad3-7341-416f-a4cb-92073f468c1e/node-exporter/0.log" Jul 09 18:06:02.282390 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.282304 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z97kp_4a677ad3-7341-416f-a4cb-92073f468c1e/kube-rbac-proxy/0.log" Jul 09 18:06:02.306001 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.305978 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z97kp_4a677ad3-7341-416f-a4cb-92073f468c1e/init-textfile/0.log" Jul 09 18:06:02.336212 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.336184 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vfl7d_b70a64e3-4b53-4533-bb89-94a9a2f8e496/kube-rbac-proxy-main/0.log" Jul 09 18:06:02.358720 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.358689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vfl7d_b70a64e3-4b53-4533-bb89-94a9a2f8e496/kube-rbac-proxy-self/0.log" Jul 09 18:06:02.379792 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.379760 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-vfl7d_b70a64e3-4b53-4533-bb89-94a9a2f8e496/openshift-state-metrics/0.log" Jul 09 18:06:02.650981 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.650951 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pbrxf_f8b2e4ea-3950-4334-bc29-48760e402ede/prometheus-operator/0.log" Jul 09 18:06:02.675976 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.675948 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pbrxf_f8b2e4ea-3950-4334-bc29-48760e402ede/kube-rbac-proxy/0.log" Jul 09 18:06:02.699741 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.699715 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-j22js_1c457ab8-33e4-485a-8fc0-0498eea1fd4f/prometheus-operator-admission-webhook/0.log" Jul 09 18:06:02.739027 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.738987 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dc6dc7bc5-8dxhd_b705aa28-1ada-4cde-bece-c9527a919c5e/telemeter-client/0.log" Jul 09 18:06:02.762935 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.762901 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dc6dc7bc5-8dxhd_b705aa28-1ada-4cde-bece-c9527a919c5e/reload/0.log" Jul 09 18:06:02.783971 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.783942 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dc6dc7bc5-8dxhd_b705aa28-1ada-4cde-bece-c9527a919c5e/kube-rbac-proxy/0.log" Jul 09 18:06:02.818848 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.818817 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/thanos-query/0.log" Jul 09 18:06:02.840970 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.840942 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/kube-rbac-proxy-web/0.log" Jul 09 18:06:02.866807 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.866765 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/kube-rbac-proxy/0.log" Jul 09 18:06:02.894897 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.894875 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/prom-label-proxy/0.log" Jul 09 18:06:02.918634 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.918563 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/kube-rbac-proxy-rules/0.log" Jul 09 18:06:02.946987 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:02.946963 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bfcdf-2qwlz_d0981033-568f-4760-8c7b-293995886d6f/kube-rbac-proxy-metrics/0.log" Jul 09 18:06:05.157560 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.157528 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55d96f48b9-xrdjk_655972fc-0e4c-4cb9-9963-ee8150160d8d/console/0.log" Jul 09 18:06:05.192480 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.192445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-kwfl8_6f7a78b0-3ebc-4fc7-9a08-b3b7a8170d79/download-server/0.log" Jul 09 18:06:05.638437 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.638405 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6"] Jul 09 18:06:05.638851 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.638821 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" Jul 09 18:06:05.638851 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.638845 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" Jul 09 18:06:05.639040 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.638935 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3398e206-8c7a-41d8-9d11-e4964124dbe4" containerName="model-chainer-raw-hpa-079fb" Jul 09 18:06:05.642263 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.642241 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.645366 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.645349 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgx2c\"/\"openshift-service-ca.crt\"" Jul 09 18:06:05.645478 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.645351 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rgx2c\"/\"default-dockercfg-srsdn\"" Jul 09 18:06:05.646788 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.646766 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgx2c\"/\"kube-root-ca.crt\"" Jul 09 18:06:05.651308 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.651287 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6"] Jul 09 18:06:05.700278 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.700242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4rx\" (UniqueName: \"kubernetes.io/projected/ded2ff5f-1554-47d7-a058-101ffab33086-kube-api-access-dw4rx\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.700469 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.700300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-sys\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.700469 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.700321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-lib-modules\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.700469 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.700378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-proc\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.700469 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.700392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-podres\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801329 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4rx\" (UniqueName: \"kubernetes.io/projected/ded2ff5f-1554-47d7-a058-101ffab33086-kube-api-access-dw4rx\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801350 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-sys\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-lib-modules\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-proc\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801427 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-podres\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801493 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-sys\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801559 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801508 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-proc\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801758 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801557 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-lib-modules\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.801758 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.801598 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ded2ff5f-1554-47d7-a058-101ffab33086-podres\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.809992 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.809961 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4rx\" (UniqueName: \"kubernetes.io/projected/ded2ff5f-1554-47d7-a058-101ffab33086-kube-api-access-dw4rx\") pod \"perf-node-gather-daemonset-ljbb6\" (UID: \"ded2ff5f-1554-47d7-a058-101ffab33086\") " pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:05.952376 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:05.952280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:06.085908 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:06.085887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6"] Jul 09 18:06:06.088078 ip-10-0-135-252 kubenswrapper[2557]: W0709 18:06:06.088050 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podded2ff5f_1554_47d7_a058_101ffab33086.slice/crio-4cbcbc3992ee4bfa43009c940ff926be90e93c9067fcc7e43ed5d0c06c4b1a6e WatchSource:0}: Error finding container 4cbcbc3992ee4bfa43009c940ff926be90e93c9067fcc7e43ed5d0c06c4b1a6e: Status 404 returned error can't find the container with id 4cbcbc3992ee4bfa43009c940ff926be90e93c9067fcc7e43ed5d0c06c4b1a6e Jul 09 18:06:06.773905 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:06.773877 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnmt7_4c6e3e49-339f-4683-9b9e-d0037d72355a/dns/0.log" Jul 09 18:06:06.799012 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:06.798983 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnmt7_4c6e3e49-339f-4683-9b9e-d0037d72355a/kube-rbac-proxy/0.log" Jul 09 18:06:06.928908 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:06.928870 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sbfkc_26ca39a8-3520-421b-b6d6-6baa0d462e68/dns-node-resolver/0.log" Jul 09 18:06:07.081734 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:07.081644 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" event={"ID":"ded2ff5f-1554-47d7-a058-101ffab33086","Type":"ContainerStarted","Data":"30258260fa32060340ffb1cb8b6b112610bf532c946998640a5a4bdd2018e503"} Jul 09 18:06:07.081734 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:07.081694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" event={"ID":"ded2ff5f-1554-47d7-a058-101ffab33086","Type":"ContainerStarted","Data":"4cbcbc3992ee4bfa43009c940ff926be90e93c9067fcc7e43ed5d0c06c4b1a6e"} Jul 09 18:06:07.081734 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:07.081730 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:07.103708 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:07.103657 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" podStartSLOduration=2.103641375 podStartE2EDuration="2.103641375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:07.101904122 +0000 UTC m=+1600.847893052" watchObservedRunningTime="2026-07-09 18:06:07.103641375 +0000 UTC m=+1600.849630304" Jul 09 18:06:07.468904 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:07.468874 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf696_b01c638e-f844-41c7-9591-bf021acc560c/node-ca/0.log" Jul 09 18:06:08.651226 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:08.651195 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-967gv_ccadb445-635f-49d8-9768-b283a79704b6/serve-healthcheck-canary/0.log" Jul 09 18:06:09.160931 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:09.160899 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz4jw_0b4ba093-2319-4aa9-862d-5eef84b04f52/kube-rbac-proxy/0.log" Jul 09 18:06:09.183668 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:09.183633 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz4jw_0b4ba093-2319-4aa9-862d-5eef84b04f52/exporter/0.log" Jul 09 18:06:09.205722 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:09.205694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz4jw_0b4ba093-2319-4aa9-862d-5eef84b04f52/extractor/0.log" Jul 09 18:06:11.318882 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:11.318824 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6b8548bc6d-6vgbn_1975b0b1-2d74-4279-887b-763723a3e758/manager/0.log" Jul 09 18:06:11.497243 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:11.497213 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-zwdsx_8bf8ff7d-e49a-46f0-864b-f5ddcf9dc188/manager/0.log" Jul 09 18:06:13.095869 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:13.095842 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rgx2c/perf-node-gather-daemonset-ljbb6" Jul 09 18:06:16.985292 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:16.985265 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-564cv_b7d10a68-ae3e-422d-8497-ce589275a277/kube-multus/0.log" Jul 09 18:06:17.009637 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.009611 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/kube-multus-additional-cni-plugins/0.log" Jul 09 18:06:17.039840 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.039802 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/egress-router-binary-copy/0.log" Jul 09 18:06:17.066430 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.066404 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/cni-plugins/0.log" Jul 09 18:06:17.089489 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.089457 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/bond-cni-plugin/0.log" Jul 09 18:06:17.114875 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.114847 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/routeoverride-cni/0.log" Jul 09 18:06:17.141412 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.141383 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/whereabouts-cni-bincopy/0.log" Jul 09 18:06:17.163954 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.163925 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vts7_40859ee7-b179-4bc9-ae44-022721d3be04/whereabouts-cni/0.log" Jul 09 18:06:17.679900 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.679868 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4tlr_79c29cb0-7adc-49ee-a3f6-d52c0c6efd68/network-metrics-daemon/0.log" Jul 09 18:06:17.697766 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:17.697738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4tlr_79c29cb0-7adc-49ee-a3f6-d52c0c6efd68/kube-rbac-proxy/0.log" Jul 09 18:06:18.946116 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:18.946075 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-controller/0.log" Jul 09 18:06:18.963218 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:18.963159 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/1.log" Jul 09 18:06:18.963381 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:18.963231 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovn-acl-logging/0.log" Jul 09 18:06:18.981777 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:18.981746 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/kube-rbac-proxy-node/0.log" Jul 09 18:06:19.003283 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:19.003254 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 18:06:19.022143 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:19.022114 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/northd/0.log" Jul 09 18:06:19.043928 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:19.043900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/nbdb/0.log" Jul 09 18:06:19.064776 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:19.064737 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/sbdb/0.log" Jul 09 18:06:19.120627 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:19.120592 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpzmp_e17f935c-cd79-4f5b-ba84-e5a0ff1c2d1a/ovnkube-controller/0.log" Jul 09 18:06:20.145520 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:20.145484 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bkf6h_bc115ae0-c011-4acd-b039-b5c116d7b412/network-check-target-container/0.log" Jul 09 18:06:21.155783 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:21.155756 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7pljg_6bb48da8-8dcd-4caa-8f0b-766ea9639952/iptables-alerter/0.log" Jul 09 18:06:21.943124 ip-10-0-135-252 kubenswrapper[2557]: I0709 18:06:21.943092 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bdrnd_9a433e11-e016-445d-8ea1-080510088ece/tuned/0.log"